Commit Graph

588 Commits

Author SHA1 Message Date
Sergey M․
3052a30d42
Improve URL extraction 2018-07-21 19:08:28 +07:00
Sergey M․
7b393f9cc5
[svt] Improve extraction and add support for pages (closes #16802) 2018-06-28 04:29:11 +07:00
Sergey M․
f51f526b0a
[foxnews] Add support for iframe embeds (closes #15810, closes #16711) 2018-06-20 23:53:37 +07:00
Sergey M․
8b4b400aef
[peertube] Improve generic support (closes #16733) 2018-06-19 23:00:36 +07:00
Sergey M․
cfd7f2a636
[apa] Add extractor (closes #15041, closes #15672) 2018-05-27 18:24:54 +07:00
Sergey M․
aee36ca832
[indavideo] Add support for generic embeds (closes #11989) 2018-05-26 01:25:40 +07:00
Sergey M․
6bd499e8ca
[peertube] Add support for generic embeds 2018-05-26 00:28:30 +07:00
Sergey M․
789b7774a7
[businessinsider] Add extractor (closes #16387, closes #16388, closes #16389) 2018-05-06 21:58:55 +07:00
Sergey M․
660a230b2d
[cloudflarestream] Add support for cloudflare streams (closes #16375) 2018-05-05 01:21:52 +07:00
Sergey M․
c21692fa94
[kaltura] Improve iframe embeds detection (closes #16337) 2018-05-01 03:09:04 +07:00
Bastian de Groot
01aec84880 [generic] Prefer enclosures over links in RSS feeds 2018-04-29 22:14:37 +07:00
Sergey M․
6cc622327f
[utils] Introduce merge_dicts 2018-04-28 02:47:17 +07:00
Sergey M․
e30991f920
[kaltura] Improve embeds detection (closes #16201) 2018-04-18 01:26:15 +07:00
Sergey M․
069937151e
[generic] Add support for tube8 embeds 2018-04-09 00:37:15 +07:00
Sergey M․
d3431dcb90
[generic] Restrict share-videos.se embeds regex to filter bogus URLs (#16115) 2018-04-09 00:25:44 +07:00
Surya Oktafendri
1fc37ca3f1 [generic] Add support for share-videos.se embeds (closes #16089) 2018-04-09 00:19:23 +07:00
Sergey M․
8b7340a45e
[lenta] Add extractor (closes #15953) 2018-03-22 23:07:31 +07:00
Sergey M․
47a5cb7734
Generalize XML manifest processing code and improve XSPF parsing (closes #15794) 2018-03-18 02:52:17 +07:00
Ricardo Constantino
96b8b9abae
[extractor/generic] Support relative URIs in _parse_xspf
<location> can have relative URIs, not just absolute.
2018-03-18 02:48:44 +07:00
Sergey M․
178ee88319
[generic] Add support for xfileshare embeds (closes #15879) 2018-03-17 23:57:07 +07:00
Sergey M․
86c8cfc555
[vice] Fix extraction and rework extractors (closes #11101, closes #13019, closes #13622, closes #13778) 2018-03-03 23:08:43 +07:00
Sergey M․
4c780fbd0a
[yapfiles] Add extractor (closes #15726, refs #11085) 2018-03-03 01:24:36 +07:00
Sergey M․
ea69624992
[youtube] Handle shared URLs with generic extractor (closes #14303) 2018-02-15 22:33:11 +07:00
Sergey M․
5399ab3f0c
[brightcove] Pass embed page URL as referrer (closes #15486) 2018-02-04 07:55:04 +07:00
Sergey M․
7d5406216a
[springboardplatform] Add extractor 2018-01-20 00:34:10 +07:00
Sergey M․
b0ead0e09a
[jwplatform] Add support for multiple embeds (closes #15192) 2018-01-07 21:49:23 +07:00
Sergey M․
2ca7ed41fe
[mediasite] Improve extraction and code style, add support for DASH (closes #11185, closes #14343, refs #5428) 2017-12-30 08:04:43 +07:00
felix
8056c8542d
[mediasite] Add extractor, subsume sandia and collegerama extractors 2017-12-30 07:23:41 +07:00
Remita Amine
3c4fbfeca2 [dailymotion] remove dailymotion cloud extractor(closes #6794)
https://web.archive.org/web/20160312110217/https://www.dmcloud.net/
2017-12-06 10:56:48 +01:00
Sergey M․
d3f8b76b69
[extractor/generic] Fix typo (closes #14902)
Don't pass video_id as mpd_id
2017-12-05 23:11:15 +07:00
John Hawkinson
805f5bf759 [Generic] ie_key in JWPlatform test 72 2017-11-24 21:39:55 +08:00
John Hawkinson
6899b1d9e8 [Generic] Update test 69 (suffolk/sjc)
suffolk.edu/sjc => suffolk.edu/sjc/live.php

Unfortunately it only transmits video a few mornings per month, so
leaving the 'skip' is probably appropriate. Updating the 'skip- to
include the calendar information though.
2017-11-24 21:39:55 +08:00
John Hawkinson
939be9adfe [JWPlatform] Support iframes
Support content.jwplatform... src attributes inside <iframe> tags in
addition to <script> tags. Just a regexp change.

Add a test (currently Generic_72).
2017-11-24 21:39:55 +08:00
Timendum
0987f2ddb2 [vshare] Fix extraction (closes #14473) 2017-11-14 22:34:45 +07:00
Remita Amine
2637fadc38 [generic] fix some of the tests 2017-10-12 16:14:43 +00:00
Sergey M․
ff3f1a62f0
[funk] Add extractor (closes #14464) 2017-10-12 00:44:13 +07:00
Sergey M․
26bae2d965
[generic] Add support for channel9 embeds (closes #14469) 2017-10-11 21:59:30 +07:00
Sergey M․
197224b7a4
Fix some regexes 2017-10-09 23:50:53 +07:00
Sergey M․
c5b7014a9c
[generic] Add support for single format Video.js embeds (closes #14371) 2017-10-01 07:01:42 +07:00
Sergey M․
63d990d285
[generic] Add support for Video.js embeds 2017-09-28 00:37:30 +07:00
Sergey M․
02d01e15f1
[generic] Fix infinite recursion for twitter:player URLs (closes #14339) 2017-09-26 21:47:18 +07:00
kayb94
9ce1ac4046 [generic] Fix support for multiple HTML5 videos on one page (closes #14080) 2017-09-23 05:49:48 +07:00
Sergey M․
66c9fa36c1
[youtube] Separate methods for embeds extraction 2017-09-06 00:48:37 +07:00
Sergey M․
ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
2017-08-27 03:31:40 +07:00
Yen Chi Hsuan
09747ba766
[liveleak] Support another liveleak embedding pattern (closes #13336) 2017-08-19 22:28:13 +08:00
Sergey M․
5551d7714d
[generic] Convert redirect URLs to unicode strings (closes #13951) 2017-08-17 23:58:01 +07:00
Sergey M․
eb02940cc7
[generic] Add test for #13895 2017-08-13 01:11:27 +07:00
Sergey M․
1663bd6e1c
[generic] Replace vzaar embed test 2017-08-11 22:02:00 +07:00
tetra-eder
41918eaa5c [generic] Add support for vzaar embeds 2017-08-11 22:00:39 +07:00
Grzegorz Ruciński
198d4cb40c [generic] Add support for another ooyala embed pattern (closes #13727) 2017-07-30 01:30:04 +07:00
Sergey M․
95908ce453
[extractor/generic] PEP 8 2017-07-29 15:13:12 +07:00
Philipp Hagemeister
24e966e8da [megaphone] Add extractor 2017-07-28 12:13:19 +02:00
Sergey M․
bb176df3bb
[spiegel:article] Move test 2017-07-17 22:19:40 +07:00
Sergey M․
3f59b0154a
[nexx:embed] Add extractor for iframe embeds 2017-07-16 04:32:37 +07:00
Sergey M․
4e826cd9ae
[nexx] Add extractor (closes #10807, closes #13465) 2017-07-15 07:02:57 +07:00
Robin Neatherway
2583c0b54e Fix bugs caused by typos 2017-07-14 23:08:32 +07:00
Sergey M․
71a1db8919
[dailymail] Add support for embeds 2017-07-09 20:06:24 +07:00
Sergey M․
73cf76a93f
[joj] Rewrite and add support for generic embeds (closes #13268) 2017-07-09 19:17:54 +07:00
Sergey M․
4328ddf82b
[extractor/common] Add support for AMP tags in _parse_html5_media_entries 2017-07-09 16:29:52 +07:00
Sergey M․
250b042c7e
[generic] Add tests for #13557 2017-07-09 16:02:38 +07:00
Sergey M․
665e945246
[eagleplatform] Add support for referrer protected videos (closes #13557) 2017-07-09 15:57:58 +07:00
Sergey M․
b311b0ead2
[generic] Extract more generic metadata (closes #13527) 2017-06-30 21:42:04 +07:00
Sergey M․
fd1c5fba6b
[facebook] Add test for plugin video embed (#13493) 2017-06-27 22:38:59 +07:00
Sergey M․
0646e34c7d
[facebook] Add support for plugin video embeds and multiple embeds (closes #13493) 2017-06-27 22:38:54 +07:00
Sergey M․
4e3637034c
[extractor/generic] Ensure format id is unicode string 2017-06-10 23:56:20 +07:00
Sergey M․
2b8e6a68f8
[extractor/generic] Add test for mediaset embed 2017-05-14 06:40:19 +07:00
Sergey M․
5d29af3d15
[extractor/generic] Add support for mediaset embeds 2017-05-14 06:29:16 +07:00
Sergey M․
946826eec7
[extractor/generic] Remove duplicate limelight code 2017-05-14 06:17:34 +07:00
Sergey M․
58bb440283
[extractor/generic] Extract wistia embed code into separate method 2017-05-13 21:51:58 +07:00
Remita Amine
6c52477f59 [condenast] improve embed support 2017-05-12 16:37:09 +01:00
Sergey M․
9edf47df7b
[brightcove] Allow whitespace around attribute names in embedded code 2017-05-01 01:03:47 +07:00
John Hawkinson
557194591a
[washingtonpost] Add support for embeds (closes #12699) 2017-04-29 23:07:26 +07:00
Sergey M․
7986c3abcd
[anvato] Improve extraction (closes #12913)
* Promote to regular shortcut based extractor
* Add mcp to access key mapping table
* Add support for embeds extraction
* Add support for anvato embeds in generic extractor
2017-04-29 19:49:04 +07:00
Yen Chi Hsuan
06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID
Fixes #12482
2017-04-18 23:04:22 +08:00
Sergey M․
ab87c26009
[extractor/generic] Add test for #12761 2017-04-17 00:36:59 +07:00
Sergey M․
e5d39886ec
[limelight] Improve embeds extraction (closes #12761)
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video
2017-04-17 00:23:16 +07:00
Sergey M․
413c1f8e2f
[extractor/generic] Extract RSS entries as url_transparent (#11163) 2017-04-16 00:57:32 +07:00
Sergey M․
0254f93b08
[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes #12178, closes #12480) 2017-04-15 20:31:49 +07:00
John Hawkinson
40158f55c9
[brightcove] Relax video tag embeds extraction
BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).
2017-04-15 20:31:43 +07:00
Remita Amine
0ee79a378a [generic] exclude urls with xml ext from valid video urls(closes #10768)(closes #11654) 2017-04-12 16:22:08 +01:00
John Hawkinson
61568e50cf [generic] Add support for <object> youtube embeds (closes #12637) 2017-04-11 00:04:32 +07:00
John Hawkinson
a01825a541 [kaltura] Add support for iframe embeds 2017-04-08 16:40:57 +07:00
Remita Amine
3e943cfe09 [generic] pass base_url to _parse_jwplayer_data 2017-03-31 14:54:06 +01:00
Random User
4f06c1c9fc Merge branch 'master' of github.com-rndusr:rg3/youtube-dl into fix/str-item-assignment 2017-03-25 21:36:59 +01:00
Random User
c73e330e7a _find_jwplayer_data() returns dict or None
This simplifies code for callers of `_find_jwplayer_data()` which no longer have
to run `_parse_json()` on the return value.

It also makes sure that `_find_jwplayer_data()` returns either a `dict` or
`None` and nothing else.
2017-03-25 19:38:30 +01:00
Random User
03486dbb01 Add test for JWPlayer where config is passed as variable 2017-03-25 19:37:45 +01:00
John Hawkinson
e8e4cc5a6a
[generic] Replace LazyYT test with skiplagged
discourse.ubuntu.com has gone away, repalce with skiplagged.com.
Be nice to have a non-frontpage URL that might be more stable,
though I don't have one. Maybe this should move to html
in test/test_InfoExtractor.py?
2017-03-25 19:53:32 +07:00
Sergey M․
54b960f340
[generic] Do not follow redirects to the same URL 2017-03-24 00:45:24 +07:00
John Hawkinson
97952bdb78 [generic] Add test for Senate ISVP iframe embed 2017-03-22 01:12:14 +08:00
John Hawkinson
46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove.
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
2017-03-19 20:40:31 +08:00
Sergey M․
a309684285
[extractor/generic] Add forgotten return for jwplayer formats 2017-03-16 03:28:01 +07:00
Sergey M․
c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes #12410) 2017-03-10 23:16:53 +07:00
Sergey M․
b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 2017-03-07 23:00:21 +07:00
Sergey M․
eb3079b6ce
[generic] Add support for rutube embeds 2017-03-04 00:46:33 +07:00
Yen Chi Hsuan
fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan
a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Remita Amine
454e5cdb17 [limelight] add support referer protected videos 2017-02-13 14:29:05 +01:00
Remita Amine
9dad941853 [disney] improve extraction
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
2017-02-13 11:43:20 +01:00
Sergey M․
5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp 2017-02-06 23:31:58 +07:00
Sergey M․
b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes #11993) 2017-02-06 23:23:40 +07:00