Sergey M․
d22dec74ff
Add --force-generic-extractor
...
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
2015-06-12 19:20:12 +06:00
Sergey M․
9872d3110c
[extractor/generic] Add support for tvigle embeds
2015-06-12 18:37:09 +06:00
Sergey M․
b859971873
[extractor/generic] Rename tvc embed url variable
2015-06-12 18:15:30 +06:00
Sergey M․
499a077761
[5tv] Improve
2015-06-12 17:48:42 +06:00
Sergey M․
5da7177729
Merge branch '5tv' of https://github.com/hlintala/youtube-dl into hlintala-5tv
2015-06-12 16:34:28 +06:00
Sergey M․
f37bdbe537
[extractor/generic] Add test for tvc embed
2015-06-12 16:28:45 +06:00
Sergey M․
2da09ff8b0
[extractor/generic] Fix tvc ie_key
2015-06-12 16:26:31 +06:00
Sergey M․
5ccddb7ecf
[tvc] Fix ie_key
2015-06-12 16:25:26 +06:00
Sergey M․
954c1d0529
[tvc] Refactor extractor names
2015-06-12 16:24:13 +06:00
Sergey M․
494f20cbdc
[extractor/generic] Add support for tvc embeds
2015-06-12 16:22:46 +06:00
Sergey M․
29902c8ec0
[tvc:embed] Add embed extraction routine
2015-06-12 16:22:23 +06:00
Sergey M․
9f15bdabc8
[tvc] Separate embed extractor
2015-06-12 16:13:36 +06:00
Sergey M․
fff3455f58
Merge branch 'tvc' of https://github.com/hlintala/youtube-dl into hlintala-tvc
2015-06-12 15:12:54 +06:00
Hannu Lintala
87446dc618
[tvc] Add extractor ( Closes #5795 )
2015-06-12 01:34:10 +03:00
Hannu Lintala
99ac0390f5
[fivetv] Add extractor ( Closes #5794 )
2015-06-12 01:03:14 +03:00
Sergey M․
ff0f0b9172
[tube8] Fix extraction ( Closes #5952 )
2015-06-11 22:18:08 +06:00
Sergey M․
97b570a94c
[generic] Improve rtl.nl embeds detection ( Closes #5950 )
2015-06-11 19:04:12 +06:00
Sergey M․
a9d56c6843
[rtlnl] Improve _VALID_URL ( #5950 )
2015-06-11 19:03:22 +06:00
Sergey M․
f98470df69
[bilibili] Fix FutureWarning
2015-06-10 23:01:12 +06:00
Jaime Marquínez Ferrándiz
eb8be1fe76
[rtbf] Extract all formats ( closes #5947 )
2015-06-10 14:12:43 +02:00
Yen Chi Hsuan
7ebd5376fe
[nfl] Relax _VALID_URL ( fixes #5940 )
2015-06-10 14:17:03 +08:00
Jaime Marquínez Ferrándiz
70219b0f43
[youtube:playlist] Use an iterator for the entries ( closes #5935 )
...
So that '--playlist-end' downloads only the required pages.
2015-06-09 23:49:11 +02:00
Sergey M․
bd5bc0cd5a
[theplatform] Check for /select/media URLs first ( #5746 )
2015-06-09 23:12:13 +06:00
Sergey M․
6e054aacca
[theplatform] Take care of /select/media URLs ( Closes #5746 )
2015-06-09 23:07:22 +06:00
Sergey M․
9d581f3d52
[cbs] Extract display_id
2015-06-09 21:39:45 +06:00
Sergey M․
9bf99891d0
[cbs] Add support for colbertlateshow ( Closes #5888 )
2015-06-09 21:23:53 +06:00
Sergey M․
d9cf48e81e
[spiegeltv] Extract all formats and prefer hls ( Closes #5843 )
2015-06-09 20:36:08 +06:00
Yen Chi Hsuan
e1b9322b09
[youtube] Restricter DASH signature pattern
...
A problematic DASH url is:
https://manifest.googlevideo.com/api/manifest/dash/mm/35/key/yt5/ip/140.112.247.145/ms/pm/mv/s/mt/1433794435/id/o-AD2Od_dsOlAUYPu03ZsVWKSbGEbCJJrMp9vnXGhnyRhd/mn/sn-aigllm7r/sparams/as%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cnh%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/fexp/9406009%2C9406821%2C9407575%2C9408142%2C9408420%2C9408710%2C9409121%2C9409208%2C9412514%2C9412780%2C9413208%2C9413426%2C9413476%2C9413503%2C9415304%2C9415753/upn/viDQrs8SnmE/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/playback_host/r4---sn-aigllm7r.googlevideo.com/ipbits/0/requiressl/yes/pl/20/itag/0/source/youtube/expire/1433824806/nh/EAQ/signature/81ABE6391E351BA495F5B041B00FF1257A353318.1A6E48ABB74E8F4AE73CA2CB1F963FC34E33DEE7/sver/3/hfr/1
2015-06-09 14:48:18 +08:00
Yen Chi Hsuan
627b964825
[kickstarted] Extract thumbnails in embedded videos ( #5929 )
2015-06-09 11:54:13 +08:00
Yen Chi Hsuan
01e21b89ee
[noco] Skip invalid timestamps ( closes #5826 )
2015-06-08 17:39:55 +08:00
Yen Chi Hsuan
788be3313d
[cnet] Fix theplatform vid extraction ( fixes #5924 )
2015-06-08 13:34:23 +08:00
Yen Chi Hsuan
e1ec93304d
[instagram:user] Truncate title to 80 characters ( #5919 )
...
This is a workaround. Currently YoutubeDL.process_info() truncates
info_dict['title'] to 200 characters, but the implementation can't
handle wide characters.
2015-06-08 01:46:33 +08:00
Yen Chi Hsuan
edb99d4c18
[instagram] Handling null values ( fixes #5919 )
...
I didn't add the test case here because it takes too much time. (7
minutes on my machine)
2015-06-08 01:17:21 +08:00
Yen Chi Hsuan
68477c3dab
[tlc] Fix test failure due to DiscoveryIE changes
2015-06-07 16:38:39 +08:00
Yen Chi Hsuan
65ba8b23f4
[discovery] Rewrite DiscoveryIE ( fixes #5898 )
...
Discovery.com now uses a completely different approach for serving
videos. At least in both test cases brightcove are involved. However,
AMF support is necessary for these brightcove videos. As a result, I
try to extract videos from the info page ('?flat=1'). The downloaded
file can be different from the one in browsers.
2015-06-07 16:34:19 +08:00
Yen Chi Hsuan
621ed9f5f4
[common] Add note and errnote field for _extract_m3u8_formats
2015-06-07 16:33:22 +08:00
Yen Chi Hsuan
b26733ba7f
[brightcove] Allow single quotes in Brightcove URLs ( fixes #5901 )
2015-06-07 15:29:42 +08:00
Sergey M․
665b6c1236
Merge branch 'hlintala-ruutu'
2015-06-07 05:38:29 +06:00
Sergey M․
9414338a48
[ruutu] Improve, make more robust and fix python 2.6 support
2015-06-07 05:37:29 +06:00
Sergey M․
717b0239fd
Merge branch 'ruutu' of https://github.com/hlintala/youtube-dl into hlintala-ruutu
2015-06-07 04:01:28 +06:00
Hannu Lintala
d00735a0c5
[ruutu] Don't use fallback for DASH and other non-HTTP urls
2015-06-06 23:01:23 +03:00
Yen Chi Hsuan
c23d5ce926
Merge branch 'PeterDing-iqiyi'
2015-06-07 02:59:27 +08:00
Yen Chi Hsuan
b5a3c7f109
[iqiyi] Cache encryption keys
2015-06-07 02:47:36 +08:00
Yen Chi Hsuan
9c5f685ef1
[iqiyi] Improve regex pattern again
2015-06-07 02:39:03 +08:00
Yen Chi Hsuan
08bb8ef201
[iqiyi] Unify get_format() and get_bid()
2015-06-07 02:25:00 +08:00
Yen Chi Hsuan
865ab62f43
[iqiyi] Make _VALID_URL more accurate
...
v_* urls are individual videos, while a_* urls are playlists, which are
not supported yet.
2015-06-07 02:13:22 +08:00
Yen Chi Hsuan
9948113590
[iqiyi] Add a multipart test case
2015-06-07 02:09:33 +08:00
Yen Chi Hsuan
c4ee87022b
[iqiyi] Change id for multipart videos
2015-06-07 01:57:05 +08:00
Yen Chi Hsuan
ffba4edb06
[iqiyi] Improve some variable names and add download notes
2015-06-07 01:52:51 +08:00
Yen Chi Hsuan
958d0b659b
[iqiyi] Reorder imports
2015-06-07 01:35:09 +08:00
Yen Chi Hsuan
aacda28b28
[iqiyi] Give error message for assertion failures
2015-06-07 01:32:03 +08:00
Yen Chi Hsuan
29e7e0781b
[iqiyi] Simplify and improve regex patterns
...
See the comments in #5849
2015-06-07 00:56:08 +08:00
Yen Chi Hsuan
7012620e2b
[iqiyi] Remove format selection codes
2015-06-07 00:44:54 +08:00
Yen Chi Hsuan
f1da861018
[iqiyi] PEP8
2015-06-07 00:37:29 +08:00
Naglis Jonaitis
05aa9c82d9
[sunporno] Fix view_count extraction
2015-06-06 13:58:52 +03:00
Naglis Jonaitis
a9e58ecd3f
[turbo] Improve description extraction
...
`og:description` is empty for some videos.
2015-06-06 13:58:51 +03:00
Hannu Lintala
223544552f
[Ruutu] Add new extractor
2015-06-06 04:29:03 +03:00
Sergey M․
3d8e9573a4
[youtube:channel] Improve channel id extraction ( #5904 )
2015-06-06 06:25:37 +06:00
Naglis Jonaitis
54eb81a087
[pornovoisines] Improve average_rating extraction and update test case
2015-06-06 03:11:43 +03:00
Naglis Jonaitis
c33c547d66
[izlesene] Avoid timestamp differences in tests due to DST
2015-06-06 02:57:21 +03:00
Naglis Jonaitis
dfe7dd9bdb
[izlesene] Unquote video URLs and simplify
2015-06-06 02:57:21 +03:00
Yen Chi Hsuan
e8ac61e840
[qqmusic] Use meaningful variable names
2015-06-05 23:19:25 +08:00
Yen Chi Hsuan
f00a650705
[qqmusic] Rearrange codes
2015-06-05 23:16:34 +08:00
Yen Chi Hsuan
4bde5ce992
Merge branch 'qqmusic-more-formats' of https://github.com/ping/youtube-dl into ping-qqmusic-more-formats
2015-06-05 23:14:44 +08:00
Yen Chi Hsuan
d31573fa37
[teamcoco] Handle incomplete m3u8 URLs ( fixes #5798 )
...
There are 2 TODOs. I don't know how to handle these cases correctly.
2015-06-05 22:59:04 +08:00
ping
8b8cde2140
[qqmusic] Set abr for mp3 formats
2015-06-05 06:04:26 +08:00
Yen Chi Hsuan
9d4f213f90
[qqmusic:toplist] List name and description are optional
2015-06-05 00:52:18 +08:00
Yen Chi Hsuan
168db222c6
Merge pull request #5891 from ping/qqmusic-toplist-fix
...
[qqmusic] Fix toplist extraction
2015-06-05 00:50:59 +08:00
Sergey M․
3d6388e34e
[tnaflix] Fix relative URLs (empflix)
2015-06-04 20:42:37 +06:00
Sergey M․
3ce9bc712a
[empflix] Fix typo
2015-06-04 20:39:03 +06:00
Sergey M․
e52c0bd0eb
[tnaflix] Modernize
2015-06-04 20:37:05 +06:00
Sergey M․
56c837ccb7
[tnaflix] Fix typo
2015-06-04 20:34:48 +06:00
ping
55e5841f14
[qqmusic] Extract additional formats (mp3-128, mp3-320)
2015-06-04 17:41:29 +08:00
ping
ed15e9ba02
[qqmusic] Remove unused import
2015-06-04 17:32:06 +08:00
ping
eedda32e6b
[qqmusic] Fix toplist
2015-06-04 11:27:18 +08:00
Sergey M.
d073055dcd
Merge pull request #5876 from slava-sh/nova
...
[nova] Update
2015-06-03 23:18:01 +05:00
Slava Shklyaev
e4ac7bb1e5
[nova] Revert "Fix extension extraction bug"
...
This reverts commit 9464a194db
2015-06-03 19:25:30 +03:00
Yen Chi Hsuan
9bac8c57e3
Merge branch 'iqiyi' of https://github.com/PeterDing/youtube-dl into PeterDing-iqiyi
2015-06-03 23:59:52 +08:00
Sergey M․
3153a2c98d
[tvigle] Skip tests
2015-06-03 20:53:54 +06:00
Sergey M․
15b74b94be
[tvigle] Capture error message
2015-06-03 20:52:47 +06:00
Sergey M․
687cb3ad35
[24video] Fix uploader extraction
2015-06-03 20:47:11 +06:00
Yen Chi Hsuan
8f94784124
[tumblr] Detect vid.me embeds ( fixes #5883 )
2015-06-03 10:26:39 +08:00
Yen Chi Hsuan
23dd1fc74c
[vidme] Always use the non-embedded page
...
For example, https://vid.me/Wmur contains more information than
https://vid.me/e/Wmur
2015-06-03 10:24:02 +08:00
Slava Shklyaev
fa971259e6
[nova] Add a comment about html in description
2015-06-02 19:09:47 +03:00
Slava Shklyaev
b0cda32f72
[nova] Fix Python 2.6 compatability issue
2015-06-02 18:30:25 +03:00
Slava Shklyaev
08b7968e28
[nova] Fix display_id extraction bug
2015-06-02 18:24:19 +03:00
Slava Shklyaev
4b5fe1349f
[nova] Comply with review
2015-06-02 18:23:42 +03:00
Sergey M․
d23da75b32
[iprima] Fix description extraction
...
`og:description` does not contain actual description anymore.
2015-06-02 21:10:18 +06:00
Slava Shklyaev
b5597738d4
[iprima] Comply with review
2015-06-02 17:42:53 +03:00
Slava Shklyaev
bc03e58565
[iprima] Update
2015-06-02 13:19:02 +03:00
Slava Shklyaev
a00234f1c5
[nova] Minor style improvement
2015-06-02 12:57:03 +03:00
Slava Shklyaev
34c0f95db2
[nova] Remove html tags from description
2015-06-02 12:56:36 +03:00
Slava Shklyaev
fcb04bcaca
[nova] Extract upload_date in some cases
2015-06-02 12:55:41 +03:00
Slava Shklyaev
9464a194db
[nova] Fix extension extraction bug
...
Replace the hardcoded flv with determine_ext. Let rtmpdump parse the url.
2015-06-02 12:54:20 +03:00
Slava Shklyaev
9f4b9118cc
[nova] Fix display_id extraction bug
...
Make id group non-greedy so that .html is not included in it.
2015-06-02 12:49:01 +03:00
Sergey M․
60158217ef
[nova] Add tv test
2015-06-02 00:57:08 +06:00
Sergey M․
923e79e2e4
[nova] Add extractor
2015-06-02 00:53:04 +06:00
Naglis Jonaitis
866b296d0f
[aftonbladet] Fix extraction and update _VALID_URL ( Fixes #5863 )
2015-06-01 16:12:11 +03:00
Sergey M․
47fd8c2f76
[patreon] Fix embeds extraction ( Closes #5862 )
2015-06-01 00:04:36 +06:00
Sergey M․
96b9690985
[imgur] Improve extraction
2015-05-31 04:05:26 +06:00
Sergey M.
002c0fb511
Merge pull request #5852 from ivan/make-playlist-url
...
[youtube] Construct a playlist URL in case the page is missing one
2015-05-31 02:19:00 +05:00
Sergey M․
7584e38ce4
[tvigle] Modernize
2015-05-31 03:01:41 +06:00
Sergey M․
eb47569f8a
[tvigle] Add support for m3u8
2015-05-31 03:00:13 +06:00
Ivan Kozik
d2a9de78df
[youtube] Construct a playlist URL in case the page is missing one
...
This fixes jumping from user/channel -> playlist for some users like
https://www.youtube.com/user/BitcoinFoundation
This also removes the superfluous log message
"add --no-playlist to just download video VIDEOID"
when downloading a user/channel.
2015-05-30 20:54:03 +00:00
Sergey M․
c5138a7ce4
[extractor/generic] Clarify test comment
2015-05-31 02:36:20 +06:00
Sergey M․
c5fa81fe81
[extractor/generic] Put all direct link tests near to each other for better navigation
2015-05-31 02:22:29 +06:00
Sergey M․
a074e92296
[extractor/generic] Add test for large compressed media
2015-05-31 02:13:24 +06:00
Sergey M․
1ddb9456c4
[extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
2015-05-31 01:23:58 +06:00
Sergey M․
58bde34a23
[extractor/generic] Force Accept-Encoding to any for extraction pass
2015-05-31 00:44:54 +06:00
Sergey M․
339516072b
[extractor/generic] Unescape video_id and title extracted from URL
2015-05-30 23:16:14 +06:00
Yen Chi Hsuan
a2d971309b
[porn91] Use single quotes
2015-05-31 00:31:18 +08:00
Yen Chi Hsuan
d05a1dbe70
[porn91] Catch daily limit error
2015-05-31 00:26:12 +08:00
Yen Chi Hsuan
a80601f8d9
[porn91] Extract more info
2015-05-31 00:20:37 +08:00
Yen Chi Hsuan
1c22238756
[porn91] Simplify
2015-05-31 00:03:19 +08:00
Yen Chi Hsuan
9ff811c5cd
[porn91] PEP8
2015-05-30 23:35:55 +08:00
Yen Chi Hsuan
1ebc05df91
Merge branch 'porn91' of https://github.com/PeterDing/youtube-dl into PeterDing-porn91
2015-05-30 23:33:10 +08:00
Sergey M․
386bdfa698
[youtube:user] Workaround 35 pages limitation ( Closes #5778 )
2015-05-30 18:29:16 +06:00
Naglis Jonaitis
1ae7ff771b
[tubitv] Add error message for videos that require login ( #5524 )
2015-05-30 14:33:27 +03:00
Naglis Jonaitis
5196b98897
[tubitv] Add new extractor ( Closes #5524 )
2015-05-30 14:16:18 +03:00
Sergey M․
e6e63e91a7
[tf1] Extend _VALID_URL ( Closes #5848 )
2015-05-30 16:18:11 +06:00
Sergey M․
b4dd98358f
[vgtv] Properly handle lives
2015-05-30 16:12:07 +06:00
Sergey M․
4d454c5e4b
[vgtv] Check for inactive videos
2015-05-30 15:15:42 +06:00
Sergey M․
5c2191a605
[vgtv] Skip wasLive hds ( Closes #5835 )
2015-05-30 15:14:10 +06:00
Sergey M․
bba5bfc890
Merge branch 'ping-soompi'
2015-05-30 14:37:18 +06:00
Sergey M․
1a5b77dc21
[crunchyroll] Fix python 3.2
2015-05-30 14:36:45 +06:00
Sergey M․
b2cf6543b2
[soompi] Improve and simplify
2015-05-30 14:30:04 +06:00
Sergey M․
0385d64223
[crunchyroll] Extract subtitles extraction routine
2015-05-30 14:12:58 +06:00
pulpe
6ebdfe43e4
[tube8] fix extractor ( fixes #5846 )
2015-05-30 09:30:14 +02:00
Yen Chi Hsuan
fafec39d41
[spiegeltv] Changed RTMP server ( fixes #5788 and fixes #5843 )
...
Thanks to @brickleroux for finding out the problem
2015-05-30 13:23:09 +08:00
PeterDing
670861bd20
[iqiyi] Do not request for unneeded formats
2015-05-30 10:37:54 +08:00
PeterDing
08f7db20c1
[youku] change format_id
2015-05-30 10:03:32 +08:00
PeterDing
605ec701b7
[iqiyi] Add new extractor for iqiyi.com
2015-05-29 23:32:04 +08:00
Yen Chi Hsuan
84e1e036c2
[senate] Extend _VALID_URL ( fixes #5836 )
2015-05-29 12:44:31 +08:00
PeterDing
1498940b10
[youku] compare bytes and str for compatible; use compat_urllib_parse for making video_url
2015-05-29 10:13:09 +08:00
PeterDing
806598b94d
[porn91] the one that _search_regex returns not needs to be checked
2015-05-29 08:21:24 +08:00
Sergey M․
e26be70bca
Merge branch 'soompi' of https://github.com/ping/youtube-dl into ping-soompi
2015-05-28 22:22:29 +06:00
PeterDing
ca45246627
[youku] compatible for python > 3.3 or > 2.7
2015-05-28 21:04:58 +08:00
PeterDing
f9355dc989
[youku] update youku
2015-05-28 17:00:09 +08:00
Sergey M․
9e0b579128
[nowtv] Add test for rtlnitro
2015-05-28 01:26:14 +06:00
Sergey M․
ff4a1279f2
[nowtv] Do not request unnecessary metadata
2015-05-28 01:15:04 +06:00
Sergey M․
9b254aa177
[nowtv] Add non-free video check
2015-05-27 23:41:43 +06:00
PeterDing
703d78bbf5
[porn91] change re to _search_regex
2015-05-28 01:37:24 +08:00
Sergey M․
d9446c7319
Merge branch 'akirk-nowtv'
2015-05-27 23:22:19 +06:00
Sergey M․
b25b645d51
[nowtv] Improve and simplify
2015-05-27 23:20:32 +06:00
PeterDing
d90b3854ca
[porn91] Add new extractor for 91porn.com
2015-05-28 00:37:00 +08:00
Sergey M․
bf24c3d017
[facebook] Improve title regex ( Closes #5816 )
2015-05-27 21:25:07 +06:00
Yen Chi Hsuan
f9f3e3df9a
[teamcoco] Use determine_ext to determine the video type
...
Some videos does not contain a 'type' field (#5798 )
2015-05-27 14:51:18 +08:00
Yen Chi Hsuan
f8d5e1cfb5
[naver] Fix video url ( fixes #5809 )
...
RTMP urls in test:naver does not work. Need more investigation.
2015-05-27 14:44:08 +08:00
Yen Chi Hsuan
c23848b3c5
[naver] Enhanced error detection
2015-05-27 14:20:29 +08:00
Yen Chi Hsuan
6d00a2dcd1
[bilibili] Catch API call failures
...
JSON are returned in a failed API call
2015-05-27 04:23:21 +08:00
