48218cdb97
Merge branch 'oppetarkiv' of https://github.com/thc202/youtube-dl into thc202-oppetarkiv
9 years ago
e9fade72f3
Add postprocessor for converting subtitles ( closes #4954 )
9 years ago
0f2c0d335b
[YoutubeDL] Use the InfoExtractor._download_webpage method for getting the subtitles
...
It handles encodings better, for example for 'http://www.npo.nl/nos-journaal/14-02-2015/POW_00942207 '
9 years ago
40b077bc7e
[oppetarkiv] Add new extractor
...
Some, if not all, of the videos appear to be geo-blocked (Sweden).
Test might fail (403 Forbidden) if not run through a Swedish connection.
9 years ago
bd3749ed69
[kaltura] Extend _VALID_URL ( Closes #5081 )
9 years ago
4ffbf77886
[odnoklassniki] Add extractor ( Closes #5075 )
9 years ago
781a7ef60a
[lynda] Use 'lstrip' for the subtitles
...
The newlines at the end are important, they separate each piece of text.
9 years ago
5b2949ee0b
Merge pull request #5076 from Ftornik/Lynda-subtitles-hotfix
...
[lynda] Fixed subtitles broken file
9 years ago
a0d646135a
[lynda] Extend _VALID_URL
9 years ago
7862ad88b7
puls4 Add new extractor
9 years ago
f3bff94cf9
[rtve] Extract duration
9 years ago
0eba1e1782
[lynda] Fixed subtitles broken file
9 years ago
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
9 years ago
da419e2332
[musicvault] Use the Kaltura extractor
9 years ago
0d97ef43be
[kaltura] Add new extractor
9 years ago
1a2313a6f2
[TheChiveIE] added support for TheChive.com ( Closes #5016 )
9 years ago
250a9bdfe2
[mpora] Improve _VALID_URL
9 years ago
6317a3e9da
[mpora] Fix extraction
9 years ago
7ab7c9e932
[gamestar] Fix title extraction
9 years ago
e129c5bc0d
[laola1tv] Allow live stream downloads
9 years ago
2e241242a3
Adding subtitles
9 years ago
9724e5d336
release 2015.02.26.2
9 years ago
63a562f95e
[escapist] Detect IP blocking and use another UA ( Fixes #5069 )
9 years ago
5c340b0387
release 2015.02.26.1
9 years ago
2a15a98a6a
[rmtp] Encode filename before invoking subprocess
...
This fixes #5066 .
Reproducible with
LC_ALL=C youtube-dl "http://www.prosieben.de/tv/germanys-next-topmodel/video/playlist/ganze-folge-episode-2-das-casting-in-muenchen "
9 years ago
72a406e7aa
[extractor/common] Pass in video_id ( #5057 )
9 years ago
feccc3ff37
Merge remote-tracking branch 'aajanki/wdr_live'
9 years ago
265bfa2c79
[letv] Simplify
9 years ago
8faf9b9b41
Merge remote-tracking branch 'yan12125/IE_Letv'
9 years ago
3e675fabe0
[airmozilla] Be more tolerant when nonessential items are missing ( #5030 )
9 years ago
cd5b4b0bc2
Merge remote-tracking branch 'duncankl/airmozilla'
9 years ago
7ef822021b
Merge remote-tracking branch 'mmue/fix-rtlnow'
9 years ago
9a48926a57
[escapist] Add support for advertisements
9 years ago
13cd97f3df
release 2015.02.26
9 years ago
183139340b
[utils] Bump our user agent
9 years ago
1c69bca258
[escapist] Fix config URL matching
9 years ago
c10ea454dc
[telecinco] Recognize more urls ( closes #5065 )
9 years ago
9504fc21b5
Fix the RTL extractor for new episodes by using a different hostname
9 years ago
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
9 years ago
b8988b63a6
[wdr] Download a live stream
9 years ago
5eaaeb7c31
[f4m] Tolerate missed fragments on live streams
9 years ago
c4f8c453ae
[f4m] Refresh fragment list periodically on live streams
9 years ago
6f4ba54079
[extractor/common] Extract HTTP (possibly f4m) URLs from a .smil file
9 years ago
637570326b
[extractor/common] Extract the first of a seq of videos in a .smil file
9 years ago
37f885650c
[eporner] Simplify and hardcode age limit
9 years ago
e765ed3a9c
[eporner] Fix redirect_code error
9 years ago
677063594e
[Letv] Update testcases
9 years ago
59c7cbd482
Update eporner.py
...
Updated to work. Old version shows an error about being unable to extract "redirect_code"
9 years ago
570311610e
[Letv] Add playlist support
9 years ago
41b264e77c
[nrktv] Workaround subtitles conversion issues on python 2.6 ( Closes #5036 )
9 years ago
df4bd0d53f
[options] Add --yes-playlist as inverse of --no-playlist ( Fixes #5051 )
9 years ago
7f09a662a0
[Letv] Add new extractor. Single video only
9 years ago
4f3b21e1c7
release 2015.02.24.2
9 years ago
54233c9080
[escapist] Support JavaScript player ( Fixes #5034 )
9 years ago
db8e13ef71
release 2015.02.24.1
9 years ago
5a42414b9c
[utils] Prevent hyphen at beginning of filename ( Fixes #5035 )
9 years ago
9c665ab72e
[rtve] PEP8
9 years ago
b665ba6aa6
release 2015.02.24
9 years ago
ec5913b5cd
[bloomberg] Modernize
9 years ago
25ac63ed71
[rtve] Extract subtitles
9 years ago
99209c2916
[youtube] Extract UL playlists as mixes ( Closes #5040 )
9 years ago
1fbaa0a521
[laola1tv] Use raw strings for regular expressions
...
Oops
9 years ago
3037b91e05
[laola1tv] Improve extraction and update test case ( #3742 )
9 years ago
ffdf972b91
[facebook] Extract all the formats ( closes #5037 )
9 years ago
459e5fbd5f
release 2015.02.23.1
9 years ago
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
9 years ago
4432db35d9
[gdcvault] Restore akamai host for rtmp videos
9 years ago
591ab1dff9
[soundgasm] PEP8
9 years ago
5bca2424bc
[gdcvault] Remove dead code
9 years ago
bd61a9e770
release 2015.02.23
9 years ago
3438e7acd2
[soundgasm] Remove unused import
9 years ago
409693984f
[soundgasm:profile] Fix _VALID_URL
9 years ago
04e8c11080
[chirbit] Clarify extractors' IE_NAMEs
9 years ago
80af2b73ab
[soundgasm] Clarify extractors' IE_NAMEs
9 years ago
3cc57f9645
[soundgasm:profile] Simplify
9 years ago
a65d4e7f14
[chirbit] Simplify and extract profile from RSS ( #5032 )
9 years ago
b531cfc019
[YoutubeDL] remove compatiblity with the old subtitles system
9 years ago
543ec2136b
Merge branch 'chirbit' of https://github.com/skypher/youtube-dl into skypher-chirbit
9 years ago
93b5071f73
[soundgasm] add profile IE.
9 years ago
ddc369f073
[chirbit] fix profile downloader regex.
9 years ago
1b40dc92eb
[airmozilla] Add new extractor
9 years ago
fcc3e6138b
[r7] Add extractor ( Closes #4405 , closes #5004 )
9 years ago
9fe6ef7ab2
[extractor/common] Fix preference for m3u8 quality selection URL
9 years ago
c010af6f19
[escapist] Make regexes more robust ( Closes #5028 )
9 years ago
35b7982303
[appletrailers] Add test ( #5027 )
9 years ago
f311cfa231
[appletrailers] Extend _VALID_URL ( Closes #5027 )
9 years ago
98c70d6fc7
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True
9 years ago
03091e372f
[ted] Always extract the subtitles
...
The required info is already in the webpage
9 years ago
4d17184817
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub
9 years ago
e086e0eb6c
release 2015.02.21
9 years ago
314368c822
[teamcoco] Fix extraction
...
Also, use a single style of quotes
9 years ago
c5181ab410
[gdcvault] Fix rtmp streams ( Closes #5024 )
9 years ago
ea5152cae1
[zapiks] Extend _VALID_URL ( #5014 )
9 years ago
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
9 years ago
4aeccadf4e
[zapiks] Add extractor ( #5014 )
9 years ago
93540ee10e
[rtve] Fix the video url
...
Changing mvod to mvod1 fixes the url, we don't need to add the query.
9 years ago
8fb3ac3649
PEP8: W503
9 years ago
77b2986b5b
[extractor/common] Recognize Indian censorship ( #5021 )
9 years ago
62b013df0d
[vimeo] Encode password before hash calculation
9 years ago
fad6768bd1
[vimeo] Fix password protected videos ( Closes #5001 )
9 years ago
1e9a9e167d
release 2015.02.20
9 years ago
3da0db62e6
[escapist] Fix extraction ( fixes #5017 )
9 years ago
e14ced7918
Merge branch 'master' of github.com:rg3/youtube-dl
9 years ago
a461a11989
[ted] Improve external video handling and add test
9 years ago
1bd838608f
prefer 'code' to 'uri' if present
9 years ago
365577f567
[chirbit] add profile extractor.
9 years ago
50efb383f0
[tv4] Add new extractor ( Closes #4839 ) ( Closes #2103 )
9 years ago
5da6bd0083
[chirbit] Add new extractor.
9 years ago
5e9a033e6e
[imgur] Allow alternative values
...
Every now and then, imgur.com goes crazy and gives us a generic title and description (otherwise it looks all fine though).
Simply update the test case to allow for that craziness.
9 years ago
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
9 years ago
dd0a58f5f0
[blinkx] Fix extraction
9 years ago
a21420389e
release 2015.02.19.3
9 years ago
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
9 years ago
8fc642eb5b
[pornhub] Fix uploader regex
9 years ago
e66e1a0046
[pornhub] Add support for playlists ( Closes #4995 )
9 years ago
d5c69f1da4
[5min] Cover joystiq.com URLs ( Closes #4962 )
9 years ago
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
9 years ago
5c8a3f862a
[nbc] Use a test video that works outside the US
9 years ago
8807f1277f
[theplatform] Convert to new subtitles system
9 years ago
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
9 years ago
b88ba05356
[imgur] Simplify
9 years ago
b74d505577
Merge remote-tracking branch 'jbboehr/imgur-gifv-improvements'
9 years ago
9e2d7dca87
[imgur] improve error check for non-video URLs
9 years ago
d236b37ac9
[imgur] improve regex #4998
9 years ago
e880c66bd8
[theonion] Modernize
9 years ago
1a13940c8d
[imgur] support regular URL
9 years ago
3d54788495
[webofstories] Fix extraction
9 years ago
71d53ace2f
[sockshare] Do not require thumbnail anymore
...
Thumbnail is not present on the website anymore.
9 years ago
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
9 years ago
bd03ffc16e
[netzkino] Skip download in test case
...
Works fine from Germany, but fails from everywhere else
9 years ago
1ac1af9b47
release 2015.02.19.2
9 years ago
3bf5705316
[imgur] Add new extractor
9 years ago
1c2528c8a3
[cbs] Modernize
9 years ago
7bd15b1a03
release 2015.02.19.1
9 years ago
6b961a85fd
[patreon] Add support for embedlies ( fixes #4969 )
9 years ago
7707004043
[patreon] Modernize
9 years ago
a025d3c5a5
release 2015.02.19
9 years ago
c460bdd56b
[sandia] Add new extractor ( #4974 )
9 years ago
b81a359eb6
[YoutubeDL] Use render_table for format listing
9 years ago
d61aefb24c
Merge remote-tracking branch 'origin/master'
9 years ago
d305dd73a3
[utils] Fix js_to_json
...
Previously, the runtime could be atrocious for longer inputs.
9 years ago
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
9 years ago
4f7cea6c53
[viki] Convert to new subtitles system
9 years ago
afbdd3acc3
[rai] Convert to new subtitles system
9 years ago
85d5866177
[yahoo] Remove md5sum from test case
...
The md5 sum has changed repeatedly, and we check whether it looks like a video anyways nowadays.
9 years ago
9789d7535d
[xtube] Fix test case
9 years ago
d8443cd3f7
[wsj] Correct test case
9 years ago
d47c26e168
[brightcove] Correct keys in playlists
9 years ago
01561da142
[nrk] Convert to new subtitles system
9 years ago
0af25f784b
[mtv] Convert to new subtitles system
9 years ago
b9b42f2ea0
[npo] Convert to new subtitles system
9 years ago
311c393838
[lynda] Convert to new subtitles system
9 years ago
18c1c42405
[drtv] Convert to new subtitles system
9 years ago
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
9 years ago
81975f4693
release 2015.02.18.1
9 years ago
3eff81fbf7
[jsinterp] Disable comment support
...
We need a proper lexer to be able to understand YouTube's code, which contains /* inside of strings.
For now it's sufficient to just disable comment support altogether.
Fixes #4976 , fixes #4979 , fixes #4980 , fixes #4981 , fixes #4982 .
Closes #4977 .
9 years ago
785521bf4f
[youtube] Remove useless if
9 years ago
6d1a55a521
[youtube] Show entire player URL when -v is given
9 years ago
9cad27008b
release 2015.02.18
9 years ago
11e611a7fa
Extend various playlist tests
9 years ago
72c1f8de06
[bandcamp:album] Fix extractor results and associated test
9 years ago
6e99868e4c
[buzzfeed] Fix playlist test case
9 years ago
4d278fde64
[ign] Amend playlist test
9 years ago
1def5f359e
[livestream] Correct playlist ID and add a test for it
9 years ago
15ec669374
[vk] Amend playlist test
9 years ago
a3fa5da496
[vimeo] Amend playlist tests
9 years ago
30965ac66a
[vimeo] Prevent infinite loops if video password verification fails
...
We're seeing this in the tests¹ right now, which do not terminate.
¹ https://travis-ci.org/jaimeMF/youtube-dl/jobs/51135858
9 years ago
09ab40b7d1
Merge branch 'progress-as-hook2'
9 years ago
edab9dbf4d
[YoutubeDL] use the 'render_table' function for listing the subtitles
9 years ago
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
9 years ago
85920dd01d
[bliptv] Convert to new subtitles system
9 years ago
fa15607773
PEP8 fixes
9 years ago
a91a2c1a83
[downloader] Remove various unneeded assignments and imports
9 years ago
16e7711e22
[downloader/http] Remove gruesome import
9 years ago
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
9 years ago
98f000409f
[radio.de] Fix extraction
9 years ago
bd7fe0cf66
[walla] Convert to new subtitles system
9 years ago
48246541da
[ceskatelevize] Convert to new subtitles system
9 years ago
4a8d4a53b1
[videolecturesnet] Fix rtmp stream glitches ( Closes #4968 )
9 years ago
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
9 years ago
be24c8697f
release 2015.02.17.2
9 years ago
0d93378887
[videolecturesnet] Check http format URLs ( Closes #4968 )
9 years ago
4069766c52
[extractor/common] Test URLs with GET
9 years ago
7010577720
release 2015.02.17.1
9 years ago
8ac27a68e6
[hls] Switch to available as a property
9 years ago
46312e0b46
release 2015.02.17
9 years ago
f9216ed6ad
Merge remote-tracking branch 'origin/master'
9 years ago
65bf37ef83
[ffmpeg] Remove trivial helper method
9 years ago
f740fae2a4
[ffmpeg] Make available a property
9 years ago
fbc503d696
[downloader/hls] Fix detection of ffmpeg/avconv (reported in #4966 )
9 years ago
662435f728
[YoutubeDL] Use a Request object for getting the cookies ( fixes #4970 )
...
So that we don't have to implement all the methods used by the cookiejar.
9 years ago
163d966707
[downloader/external] curl: Add the '--location' flag
...
curl doesn't follow redirections by default
9 years ago
85729c51af
[downloader] Add --hls-prefer-native to use the native HLS downloader ( #4966 )
9 years ago
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
9 years ago
a1f2a06b34
[dailymotion] Convert to new subtitles system
9 years ago
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
9 years ago
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
9 years ago
6b597516c1
[atresplayer] Convert to new subtitles system
9 years ago
b5857f62e2
[crunchyroll] Convert to new subtitles system
9 years ago
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
9 years ago
1db5fbcfe3
release 2015.02.16.1
9 years ago
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
9 years ago
a568180441
release 2015.02.16
9 years ago
85e80f71cd
[yam] Allow faults in optional fields ( #4943 )
9 years ago
bfa6bdcd8b
Merge remote-tracking branch 'yan12125/IE_Yam'
9 years ago
03cd72b007
[extractor/common] Move up filesize
...
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
9 years ago
5bfd430f81
Merge remote-tracking branch 'origin/master'
9 years ago
73fac4e911
[ffmpeg] Add --ffmpeg-location
9 years ago
f813928e4b
[bbccouk] Fix fallback to legacy playlist
9 years ago
b9c7a97318
[history] Add extractor ( Closes #4934 )
9 years ago
9fb2f1cd6d
[theplatform] Add URL sign capability
9 years ago
6ca7732d5e
[extractor/common] Fix link to external documentation
9 years ago
b0ab0fac49
Remove unused imports
9 years ago
a294bce82f
[streamcz] Fix extraction ( Closes #4940 )
9 years ago
76d1466b08
[drtuber] Add one more title regex
9 years ago
1888d3f7b3
Merge pull request #4951 from peugeot/beeg
...
[beeg] fix test
9 years ago
c2787701cc
Merge pull request #4950 from peugeot/drtuber
...
[drtuber] fix extraction
9 years ago
52e1d0ccc4
[beeg] fix test
9 years ago
10e3c4c221
[drtuber] fix extraction
9 years ago
68f2d273bf
[sunporno] Keep old video regex just in case
9 years ago
ae1580d790
[sunporno] fix extraction
9 years ago
a4f3d779db
[nbcnews] Simplify
9 years ago
d9aa2b784d
Support NBC Nightly News broadcasts
9 years ago
cffcbc02de
[postprocessor/ffmpeg] Don't let ffmpeg read from stdin ( fixes #4945 )
...
If you run 'while read aurl ; do youtube-dl --extract-audio "${aurl}"; done < path_to_batch_file' (batch_file contains one url per line) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url, something like 'tube.com/watch?v=<id>'.
9 years ago
9347fddbfc
[1tv] Cover arbitraty URLs
9 years ago
037e9437e4
[camdemy] Fix _VALID_URL
9 years ago
ae6423d704
[bambuser] Fix 'uploader_id' extraction ( fixes #4944 )
9 years ago
7105440cec
[Yam] Add new extractor
9 years ago
171ca612af
[npo:radio] Move to extractor to common npo place and add extractor for fragments
9 years ago
c3d64fc1b3
[nporadio] Edit to confirm to flake8 standards
9 years ago
7c24ce225d
[NPORadio] Added extractor for live radio
9 years ago
08b38d5401
[camdemy] Simplify and make more robust ( #4938 )
...
Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.
9 years ago
024c53694d
Merge remote-tracking branch 'yan12125/IE_camdemy'
9 years ago
7e6011101f
[camdemy] Python2 compatibility
9 years ago
c40feaba77
[camdemy] Add support for folders
9 years ago
5277f09dfc
release 2015.02.11
9 years ago
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
9 years ago
f36f92f4da
[aes] style: Put __all__ variable at the end of the file
9 years ago
124f3bc67d
[dotsub] Fix extraction and modernize
9 years ago
8367d3f3cb
[camdemy] Detection of external sources
9 years ago
c56d7d899d
[dctptv] Skip rtmp download
9 years ago
ea5db8469e
[canalplus] Add support for itele.fr URLs ( Closes #4931 )
9 years ago
3811c567e7
[teamcoco] Fix video id extraction
9 years ago
8708d76425
[camdemy] Add new extractor
...
Single file download done, while folder extaction in plan
9 years ago
054fe3cc40
[ntvru] Adapt to new direct delivery and modernize ( Closes #4918 )
9 years ago
af0d11f244
release 2015.02.10.5
9 years ago
9650885be9
[escapist] Filter video differently ( Fixes #4919 )
9 years ago
596ac6e31f
[escapist] Modernize
9 years ago
612ee37365
release 2015.02.10.4
9 years ago
442c37b7a9
[YoutubeDL] Do not perform filter matching on partial results ( Fixes #4921 )
9 years ago
Sergey M․
Jaime Marquínez Ferrándiz
thc202
HanYOLO
Sergey
Naglis Jonaitis
anovicecodemonkey
PishPosh.McGee
Philipp Hagemeister
Markus Müller
Antti Ajanki
logon84
Yen Chi Hsuan
Leslie P. Polzer
Duncan Keall
minusf
John Boehr
peugeot
Ryan Schmidt
robin