475 Commits (46bc9b7d7cea2e161670e65abe42ef01d39e8957)

Author SHA1 Message Date
Sergey M․ 46bc9b7d7c
[utils] Allow None in remove_{start,end} 8 years ago
Yen Chi Hsuan cdd94c2eae
[utils] Check for None values in SOCKS proxy
Originally reported at
https://github.com/rg3/youtube-dl/pull/9287#issuecomment-219617864
8 years ago
Yen Chi Hsuan 79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049, related to #9440
8 years ago
Sergey M․ cda6d47aad
[utils] Simplify integer conversion in js_to_json 8 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 8 years ago
felix bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
8 years ago
Yen Chi Hsuan 7581bfc958
[utils] Unquote crendentials passed to SOCKS proxies
Fixes #9450
8 years ago
Yen Chi Hsuan 778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
Fixes #9463
8 years ago
Yen Chi Hsuan 702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output 8 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 8 years ago
Yen Chi Hsuan d5ae6bb501
[utils] Add rationale for register_socks_protocols 8 years ago
Yen Chi Hsuan 51fb4995a5
[utils] Register SOCKS protocols in urllib and support SOCKS4A 8 years ago
Yen Chi Hsuan 71aff18809
[socks] Support SOCKS proxies 8 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 8 years ago
Sergey M․ abc97b5eda
[utils] Allow empty attribute values in get_element_by_attribute (Closes #9415) 8 years ago
Adam Thalhammer c587cbb793 improved performance by extracting accented chars to top level 8 years ago
Adam Thalhammer 79a2e94e79 Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347 8 years ago
Sergey M․ eb9ee19422
[utils] Allow None mimetypes in mimetype2ext 8 years ago
Sergey M b6c0d4f431 Merge pull request #9110 from remitamine/parse_duration
[utils] imporove parse_duration to handle more formats
8 years ago
remitamine acaff49575 [utils] imporove parse_duration to handle more formats 8 years ago
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
8 years ago
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081).
8 years ago
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request 8 years ago
Sergey M․ ed0291d153 [utils] Add update_Request 8 years ago
Sergey M․ 17bcc626bf [utils] Extract sanitize_url routine 8 years ago
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes #8974
8 years ago
Yen Chi Hsuan 622d19160b [utils] Clarify Python versions affected by buggy struct module 8 years ago
Yen Chi Hsuan efbed08dc2 [utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError

Fixes #8890
8 years ago
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 8 years ago
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
8 years ago
Sergey M․ 810c10baa1 [utils] Use compat_xpath 8 years ago
Sergey M․ c5229f3926 [utils] PEP 8 8 years ago
remitamine 83548824c2 Merge pull request #8092 from bpfoley/twitter-thumbnail
[utils] Add extract_attributes for extracting html tag attributes
8 years ago
Sergey M․ 2f7ae819ac [utils] PEP 8 8 years ago
Sergey M․ fb47597b09 [bbc] Generalize unit table lookup and add parse_count 8 years ago
Yen Chi Hsuan 25cb05bda9 [utils] Remove codec2ext
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
8 years ago
Yen Chi Hsuan 6d210f2090 [utils] Add more codecs to codec2ext
BBC uses avc3. Here's an example (thanks to @remitamine for this example)

http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd

See also https://trac.ffmpeg.org/ticket/5217
8 years ago
Yen Chi Hsuan 19a17d4623 [utils] Add codec2ext 8 years ago
Jaime Marquínez Ferrándiz 3233a68fbb [utils] update_url_query: Encode the strings in the query dict
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
8 years ago
remitamine 1255733945 Merge pull request #8739 from remitamine/update_url_params
[utils] add update_url_query function to create or update query string params
8 years ago
remitamine 38f9ef31dc [utils] add update_url_query function 8 years ago
Yen Chi Hsuan 0cae023b24 Merge branch 'jython-support'
Closes #8302
8 years ago
Yen Chi Hsuan 8ee239e921 [utils] Jython support - handle filenames correctly
Now test:youtube downloads
8 years ago
Brian Foley 8bb56eeeea [utils] Add extract_attributes for extracting html tag attributes
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
8 years ago
remitamine e07237f640 [utils] remove check for val from find_xpath_attr 8 years ago
Yen Chi Hsuan 5eb6bdced4 [utils] Multiple changes to base_n()
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
8 years ago
Yen Chi Hsuan 680079be39 [utils] Relaxing regex in decode_packed_codes for vidzi 8 years ago
Yen Chi Hsuan f52354a889 [utils] Move codes for handling eval() from iqiyi.py 8 years ago
Yen Chi Hsuan 59f898b7a7 [utils] Merge base_n functions 8 years ago
Yen Chi Hsuan 481888294d [utils] Add base36 for use in Vidzi 8 years ago