ChangeLog 95.7 KB
Newer Older
1 2 3
version <unreleased>

Extractors
Sergey M․'s avatar
Sergey M․ committed
4 5 6 7 8 9 10 11 12 13 14 15
* [youtube] Fix live streams extraction (#15202)
* [wdr] Bypass geo restriction
* [wdr] Rework extractors (#14598)
+ [wdr] Add support for wdrmaus.de/elefantenseite (#14598)
+ [gamestar] Add support for gamepro.de (#3384)
* [viafree] Skip rtmp formats (#15232)
+ [pandoratv] Add support for mobile URLs (#12441)
+ [pandoratv] Add support for new URL format (#15131)
+ [ximalaya] Add support for ximalaya.com (#14687)
+ [digg] Add support for digg.com (#15214)
* [limelight] Tolerate empty pc formats (#15150, #15151, #15207)
* [ndr:embed:base] Make separate formats extraction non fatal (#15203)
16
+ [weibo] Add extractor (#15079)
Sergey M․'s avatar
Sergey M․ committed
17 18 19
+ [ok] Add support for live streams
* [canalplus] Fix extraction (#15072)
* [bilibili] Fix extraction (#15188)
20 21


Sergey M․'s avatar
Sergey M․ committed
22
version 2018.01.07
23

Sergey M․'s avatar
Sergey M․ committed
24 25 26 27
Core
* [utils] Fix youtube-dl under PyPy3 on Windows
* [YoutubeDL] Output python implementation in debug header

28
Extractors
Sergey M․'s avatar
Sergey M․ committed
29 30 31 32 33
+ [jwplatform] Add support for multiple embeds (#15192)
* [mitele] Fix extraction (#15186)
+ [motherless] Add support for groups (#15124)
* [lynda] Relax URL regular expression (#15185)
* [soundcloud] Fallback to avatar picture for thumbnail (#12878)
34
* [youku] Fix list extraction (#15135)
35
* [openload] Fix extraction (#15166)
Sergey M․'s avatar
Sergey M․ committed
36 37
* [lynda] Skip invalid subtitles (#15159)
* [twitch] Pass video id to url_result when extracting playlist (#15139)
38
* [rtve.es:alacarta] Fix extraction of some new URLs
Sergey M․'s avatar
Sergey M․ committed
39
* [acast] Fix extraction (#15147)
40 41


Sergey M․'s avatar
Sergey M․ committed
42
version 2017.12.31
43

Sergey M․'s avatar
Sergey M․ committed
44 45 46 47 48 49 50 51
Core
+ [extractor/common] Add container meta field for formats extracted
  in _parse_mpd_formats (#13616)
+ [downloader/hls] Use HTTP headers for key request
* [common] Use AACL as the default fourcc when AudioTag is 255
* [extractor/common] Fix extraction of DASH formats with the same
  representation id (#15111)

52
Extractors
Sergey M․'s avatar
Sergey M․ committed
53 54 55 56
+ [slutload] Add support for mobile URLs (#14806)
* [abc:iview] Bypass geo restriction
* [abc:iview] Fix extraction (#14711, #14782, #14838, #14917, #14963, #14985,
  #15035, #15057, #15061, #15071, #15095, #15106)
57
* [openload] Fix extraction (#15118)
Sergey M․'s avatar
Sergey M․ committed
58 59 60 61 62 63 64 65 66
- [sandia] Remove extractor
- [collegerama] Remove extractor
+ [mediasite] Add support for sites based on Mediasite Video Platform (#5428,
  #11185, #14343)
+ [ufctv] Add support for ufc.tv (#14520)
* [pluralsight] Fix missing first line of subtitles (#11118)
* [openload] Fallback on f-page extraction (#14665, #14879)
* [vimeo] Improve password protected videos extraction (#15114)
* [aws] Fix canonical/signed headers generation on python 2 (#15102)
67 68


Sergey M․'s avatar
Sergey M․ committed
69
version 2017.12.28
70 71

Extractors
Sergey M․'s avatar
Sergey M․ committed
72 73 74 75 76 77 78 79
+ [internazionale] Add support for internazionale.it (#14973)
* [playtvak] Relax video regular expression and make description optional
  (#15037)
+ [filmweb] Add support for filmweb.no (#8773, #10368)
+ [23video] Add support for 23video.com
+ [espn] Add support for fivethirtyeight.com (#6864)
+ [umg:de] Add support for universal-music.de (#11582, #11584)
+ [espn] Add support for espnfc and extract more formats (#8053)
80
* [youku] Update ccode (#14880)
Sergey M․'s avatar
Sergey M․ committed
81
+ [openload] Add support for oload.stream (#15070)
82
* [youku] Fix list extraction (#15065)
83 84


Sergey M․'s avatar
Sergey M․ committed
85
version 2017.12.23
Sergey M․'s avatar
Sergey M․ committed
86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113

Core
* [extractor/common] Move X-Forwarded-For setup code into _request_webpage
+ [YoutubeDL] Add support for playlist_uploader and playlist_uploader_id in
  output template (#11427, #15018)
+ [extractor/common] Introduce uploader, uploader_id and uploader_url
  meta fields for playlists (#11427, #15018)
* [downloader/fragment] Encode filename of fragment being removed (#15020)
+ [utils] Add another date format pattern (#14999)

Extractors
+ [kaltura] Add another embed pattern for entry_id
+ [7plus] Add support for 7plus.com.au (#15043)
* [animeondemand] Relax login error regular expression
+ [shahid] Add support for show pages (#7401)
+ [youtube] Extract uploader, uploader_id and uploader_url for playlists
  (#11427, #15018)
* [afreecatv] Improve format extraction (#15019)
+ [cspan] Add support for audio only pages and catch page errors (#14995)
+ [mailru] Add support for embed URLs (#14904)
* [crunchyroll] Future-proof XML element checks (#15013)
* [cbslocal] Fix timestamp extraction (#14999, #15000)
* [discoverygo] Correct TTML subtitle extension
* [vk] Make view count optional (#14979)
* [disney] Skip Apple FairPlay formats (#14982)
* [voot] Fix format extraction (#14758)


Sergey M․'s avatar
Sergey M․ committed
114
version 2017.12.14
Sergey M․'s avatar
Sergey M․ committed
115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133

Core
* [postprocessor/xattr] Clarify NO_SPACE message (#14970)
* [downloader/http] Return actual download result from real_download (#14971)

Extractors
+ [itv] Extract more subtitles and duration
* [itv] Improve extraction (#14944)
+ [byutv] Add support for geo restricted videos
* [byutv] Fix extraction (#14966, #14967)
+ [bbccouk] Fix extraction for 320k HLS streams
+ [toutv] Add support for special video URLs (#14179)
* [discovery] Fix free videos extraction (#14157, #14954)
* [tvnow] Fix extraction (#7831)
+ [nickelodeon:br] Add support for nickelodeon brazil websites (#14893)
* [nick] Improve extraction (#14876)
* [tbs] Fix extraction (#13658)


Sergey M․'s avatar
Sergey M․ committed
134
version 2017.12.10
Sergey M․'s avatar
Sergey M․ committed
135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160

Core
+ [utils] Add sami mimetype to mimetype2ext

Extractors
* [culturebox] Improve video id extraction (#14947)
* [twitter] Improve extraction (#14197)
+ [udemy] Extract more HLS formats
* [udemy] Improve course id extraction (#14938)
+ [stretchinternet] Add support for portal.stretchinternet.com (#14576)
* [ellentube] Fix extraction (#14407, #14570)
+ [raiplay:playlist] Add support for playlists (#14563)
* [sonyliv] Bypass geo restriction
* [sonyliv] Extract higher quality formats (#14922)
* [fox] Extract subtitles
+ [fox] Add support for Adobe Pass authentication (#14205, #14489)
- [dailymotion:cloud] Remove extractor (#6794)
* [xhamster] Fix thumbnail extraction (#14780)
+ [xhamster] Add support for mobile URLs (#14780)
* [generic] Don't pass video id as mpd id while extracting DASH (#14902)
* [ard] Skip invalid stream URLs (#14906)
* [porncom] Fix metadata extraction (#14911)
* [pluralsight] Detect agreement request (#14913)
* [toutv] Fix login (#14614)


Sergey M․'s avatar
Sergey M․ committed
161
version 2017.12.02
Sergey M․'s avatar
Sergey M․ committed
162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183

Core
+ [downloader/fragment] Commit part file after each fragment
+ [extractor/common] Add durations for DASH fragments with bare SegmentURLs
+ [extractor/common] Add support for DASH manifests with SegmentLists with
  bare SegmentURLs (#14844)
+ [utils] Add hvc1 codec code to parse_codecs

Extractors
* [xhamster] Fix extraction (#14884)
* [youku] Update ccode (#14872)
* [mnet] Fix format extraction (#14883)
+ [xiami] Add Referer header to API request
* [mtv] Correct scc extention in extracted subtitles (#13730)
* [vvvvid] Fix extraction for kenc videos (#13406)
+ [br] Add support for BR Mediathek videos (#14560, #14788)
+ [daisuki] Add support for motto.daisuki.com (#14681)
* [odnoklassniki] Fix API metadata request (#14862)
* [itv] Fix HLS formats extraction
+ [pbs] Add another media id regular expression


Sergey M․'s avatar
Sergey M․ committed
184
version 2017.11.26
185

Sergey M․'s avatar
Sergey M․ committed
186 187 188
Core
* [extractor/common] Use final URL when dumping request (#14769)

189
Extractors
Sergey M․'s avatar
Sergey M․ committed
190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205
* [fczenit] Fix extraction
- [firstpost] Remove extractor
* [freespeech] Fix extraction
* [nexx] Extract more formats
+ [openload] Add support for openload.link (#14763)
* [empflix] Relax URL regular expression
* [empflix] Fix extractrion
* [tnaflix] Don't modify download URLs (#14811)
- [gamersyde] Remove extractor
* [francetv:generationwhat] Fix extraction
+ [massengeschmacktv] Add support for Massengeschmack TV
* [fox9] Fix extraction
* [faz] Fix extraction and add support for Perform Group embeds (#14714)
+ [performgroup] Add support for performgroup.com
+ [jwplatform] Add support for iframes (#14828)
* [culturebox] Fix extraction (#14827)
206
* [youku] Fix extraction; update ccode (#14815)
Sergey M․'s avatar
Sergey M․ committed
207 208 209 210 211
* [livestream] Make SMIL extraction non fatal (#14792)
+ [drtuber] Add support for mobile URLs (#14772)
+ [spankbang] Add support for mobile URLs (#14771)
* [instagram] Fix description, timestamp and counters extraction (#14755)

212

Sergey M․'s avatar
Sergey M․ committed
213
version 2017.11.15
214

Sergey M․'s avatar
Sergey M․ committed
215 216 217 218
Core
* [common] Skip Apple FairPlay m3u8 manifests (#14741)
* [YoutubeDL] Fix playlist range optimization for --playlist-items (#14740)

219
Extractors
Sergey M․'s avatar
Sergey M․ committed
220 221 222 223 224 225 226 227 228 229 230 231
* [vshare] Capture and output error message
* [vshare] Fix extraction (#14473)
* [crunchyroll] Extract old RTMP formats
* [tva] Fix extraction (#14736)
* [gamespot] Lower preference of HTTP formats (#14652)
* [instagram:user] Fix extraction (#14699)
* [ccma] Fix typo (#14730)
- Remove sensitive data from logging in messages
* [instagram:user] Fix extraction (#14699)
+ [gamespot] Add support for article URLs (#14652)
* [gamespot] Skip Brightcove Once HTTP formats (#14652)
* [cartoonnetwork] Update tokenizer_src (#14666)
232
+ [wsj] Recognize another URL pattern (#14704)
Sergey M․'s avatar
Sergey M․ committed
233 234
* [pandatv] Update API URL and sign format URLs (#14693)
* [crunchyroll] Use old login method (#11572)
235 236


Sergey M․'s avatar
Sergey M․ committed
237
version 2017.11.06
Sergey M․'s avatar
Sergey M․ committed
238 239 240 241 242 243 244 245 246 247 248 249 250 251 252

Core
+ [extractor/common] Add protocol for f4m formats
* [f4m] Prefer baseURL for relative URLs (#14660)
* [extractor/common] Respect URL query in _extract_wowza_formats (14645)

Extractors
+ [hotstar:playlist] Add support for playlists (#12465)
* [hotstar] Bypass geo restriction (#14672)
- [22tracks] Remove extractor (#11024, #14628)
+ [skysport] Sdd support ooyala videos protected with embed_token (#14641)
* [gamespot] Extract formats referenced with new data fields (#14652)
* [spankbang] Detect unavailable videos (#14644)


Sergey M․'s avatar
Sergey M․ committed
253
version 2017.10.29
Sergey M․'s avatar
Sergey M․ committed
254 255 256 257 258 259 260 261 262 263

Core
* [extractor/common] Prefix format id for audio only HLS formats
+ [utils] Add support for zero years and months in parse_duration

Extractors
* [egghead] Fix extraction (#14388)
+ [fxnetworks] Extract series metadata (#14603)
+ [younow] Add support for younow.com (#9255, #9432, #12436)
* [dctptv] Fix extraction (#14599)
Sergey M․'s avatar
Sergey M․ committed
264 265
* [youtube] Restrict embed regular expression (#14600)
* [vimeo] Restrict iframe embed regular expression (#14600)
Sergey M․'s avatar
Sergey M․ committed
266 267 268 269 270 271 272 273 274 275 276 277
* [soundgasm] Improve extraction (#14588)
- [myvideo] Remove extractor (#8557)
+ [nbc] Add support for classic-tv videos (#14575)
+ [vrtnu] Add support for cookies authentication and simplify (#11873)
+ [canvas] Add support for vrt.be/vrtnu (#11873)
* [twitch:clips] Fix title extraction (#14566)
+ [ndtv] Add support for sub-sites (#14534)
* [dramafever] Fix login error message extraction
+ [nick] Add support for more nickelodeon sites (no, dk, se, ch, fr, es, pt,
  ro, hu) (#14553)


Sergey M․'s avatar
Sergey M․ committed
278
version 2017.10.20
Sergey M․'s avatar
Sergey M․ committed
279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297

Core
* [downloader/fragment] Report warning instead of error on inconsistent
  download state
* [downloader/hls] Fix total fragments count when ad fragments exist

Extractors
* [parliamentliveuk] Fix extraction (#14524)
* [soundcloud] Update client id (#14546)
+ [servus] Add support for servus.com (#14362)
+ [unity] Add support for unity3d.com (#14528)
* [youtube] Replace youtube redirect URLs in description (#14517)
* [pbs] Restrict direct video URL regular expression (#14519)
* [drtv] Respect preference for direct HTTP formats (#14509)
+ [eporner] Add support for embed URLs (#14507)
* [arte] Capture and output error message
* [niconico] Improve uploader metadata extraction robustness (#14135)


Sergey M․'s avatar
Sergey M․ committed
298
version 2017.10.15.1
Sergey M․'s avatar
Sergey M․ committed
299 300 301 302 303 304 305 306 307 308 309

Core
* [downloader/hls] Ignore anvato ad fragments (#14496)
* [downloader/fragment] Output ad fragment count

Extractors
* [scrippsnetworks:watch] Bypass geo restriction
+ [anvato] Add ability to bypass geo restriction
* [redditr] Fix extraction for URLs with query (#14495)


Sergey M․'s avatar
Sergey M․ committed
310
version 2017.10.15
311

Sergey M․'s avatar
Sergey M․ committed
312 313 314
Core
+ [common] Add support for jwplayer youtube embeds

315
Extractors
Sergey M․'s avatar
Sergey M․ committed
316 317 318 319 320 321 322 323 324 325
* [scrippsnetworks:watch] Fix extraction (#14389)
* [anvato] Process master m3u8 manifests
* [youtube] Fix relative URLs in description
* [spike] Bypass geo restriction
+ [howstuffworks] Add support for more domains
* [infoq] Fix http format downloading
+ [rtlnl] Add support for another type of embeds
+ [onionstudios] Add support for bulbs-video embeds
* [udn] Fix extraction
* [shahid] Fix extraction (#14448)
326
* [kaltura] Ignore Widevine encrypted video (.wvm) (#14471)
Sergey M․'s avatar
Sergey M․ committed
327 328
* [vh1] Fix extraction (#9613)

329

Sergey M․'s avatar
Sergey M․ committed
330
version 2017.10.12
331

Sergey M․'s avatar
Sergey M․ committed
332 333 334
Core
* [YoutubeDL] Improve _default_format_spec (#14461)

335
Extractors
Sergey M․'s avatar
Sergey M․ committed
336 337 338 339 340 341 342 343 344
* [steam] Fix extraction (#14067)
+ [funk] Add support for funk.net (#14464)
+ [nexx] Add support for shortcuts and relax domain id extraction
+ [voxmedia] Add support for recode.net (#14173)
+ [once] Add support for vmap URLs
+ [generic] Add support for channel9 embeds (#14469)
* [tva] Fix extraction (#14328)
+ [tubitv] Add support for new URL format (#14460)
- [afreecatv:global] Remove extractor
345
- [youtube:shared] Removed extractor (#14420)
Sergey M․'s avatar
Sergey M․ committed
346
+ [slideslive] Add support for slideslive.com (#2680)
347
+ [facebook] Support thumbnails (#14416)
Sergey M․'s avatar
Sergey M․ committed
348 349 350 351 352 353
* [vvvvid] Fix episode number extraction (#14456)
* [hrti:playlist] Relax URL regular expression
* [wdr] Relax media link regular expression (#14447)
* [hrti] Relax URL regular expression (#14443)
* [fox] Delegate extraction to uplynk:preplay (#14147)
+ [youtube] Add support for hooktube.com (#14437)
354 355


Sergey M․'s avatar
Sergey M․ committed
356
version 2017.10.07
Sergey M․'s avatar
Sergey M․ committed
357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379

Core
* [YoutubeDL] Ignore duplicates in --playlist-items
* [YoutubeDL] Fix out of range --playlist-items for iterable playlists and
  reduce code duplication (#14425)
+ [utils] Use cache in OnDemandPagedList by default
* [postprocessor/ffmpeg] Convert to opus using libopus (#14381)

Extractors
* [reddit] Sort formats (#14430)
* [lnkgo] Relax URL regular expression (#14423)
* [pornflip] Extend URL regular expression (#14405, #14406)
+ [xtube] Add support for embed URLs (#14417)
+ [xvideos] Add support for embed URLs and improve extraction (#14409)
* [beeg] Fix extraction (#14403)
* [tvn24] Relax URL regular expression (#14395)
* [nbc] Fix extraction (#13651, #13715, #14137, #14198, #14312, #14314, #14378,
  #14392, #14414, #14419, #14431)
+ [ketnet] Add support for videos without direct sources (#14377)
* [canvas] Generalize mediazone.vrt.be extractor and rework canvas and een
+ [afreecatv] Add support for adult videos (#14376)


Sergey M․'s avatar
Sergey M․ committed
380
version 2017.10.01
Sergey M․'s avatar
Sergey M․ committed
381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397

Core
* [YoutubeDL] Document youtube_include_dash_manifest

Extractors
+ [tvp] Add support for new URL schema (#14368)
+ [generic] Add support for single format Video.js embeds (#14371)
* [yahoo] Bypass geo restriction for brightcove (#14210)
* [yahoo] Use extracted brightcove account id (#14210)
* [rtve:alacarta] Fix extraction (#14290)
+ [yahoo] Add support for custom brigthcove embeds (#14210)
+ [generic] Add support for Video.js embeds
+ [gfycat] Add support for /gifs/detail URLs (#14322)
* [generic] Fix infinite recursion for twitter:player URLs (#14339)
* [xhamsterembed] Fix extraction (#14308)


Sergey M․'s avatar
Sergey M․ committed
398
version 2017.09.24
399 400

Core
401
+ [options] Accept lrc as a subtitle conversion target format (#14292)
402 403
* [utils] Fix handling raw TTML subtitles (#14191)

Sergey M․'s avatar
Sergey M․ committed
404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427
Extractors
* [24video] Fix timestamp extraction and make non fatal (#14295)
+ [24video] Add support for 24video.adult (#14295)
+ [kakao] Add support for tv.kakao.com (#12298, #14007)
+ [twitter] Add support for URLs without user id (#14270)
+ [americastestkitchen] Add support for americastestkitchen.com (#10764,
  #13996)
* [generic] Fix support for multiple HTML5 videos on one page (#14080)
* [mixcloud] Fix extraction (#14088, #14132)
+ [lynda] Add support for educourse.ga (#14286)
* [beeg] Fix extraction (#14275)
* [nbcsports:vplayer] Correct theplatform URL (#13873)
* [twitter] Fix duration extraction (#14141)
* [tvplay] Bypass geo restriction
+ [heise] Add support for YouTube embeds (#14109)
+ [popcorntv] Add support for popcorntv.it (#5914, #14211)
* [viki] Update app data (#14181)
* [morningstar] Relax URL regular expression (#14222)
* [openload] Fix extraction (#14225, #14257)
* [noovo] Fix extraction (#14214)
* [dailymotion:playlist] Relax URL regular expression (#14219)
+ [twitch] Add support for go.twitch.tv URLs (#14215)
* [vgtv] Relax URL regular expression (#14223)

428

Sergey M․'s avatar
Sergey M․ committed
429
version 2017.09.15
Sergey M․'s avatar
Sergey M․ committed
430 431 432 433 434 435 436 437 438 439 440 441 442 443

Core
* [downloader/fragment] Restart inconsistent incomplete fragment downloads
  (#13731)
* [YoutubeDL] Download raw subtitles files (#12909, #14191)

Extractors
* [condenast] Fix extraction (#14196, #14207)
+ [orf] Add support for f4m stories
* [tv4] Relax URL regular expression (#14206)
* [animeondemand] Bypass geo restriction
+ [animeondemand] Add support for flash videos (#9944)


Sergey M․'s avatar
Sergey M․ committed
444
version 2017.09.11
Sergey M․'s avatar
Sergey M․ committed
445 446 447 448 449

Extractors
* [rutube:playlist] Fix suitable (#14166)


Sergey M․'s avatar
Sergey M․ committed
450
version 2017.09.10
Sergey M․'s avatar
Sergey M․ committed
451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478

Core
+ [utils] Introduce bool_or_none
* [YoutubeDL] Ensure dir existence for each requested format (#14116)

Extractors
* [fox] Fix extraction (#14147)
* [rutube] Use bool_or_none
* [rutube] Rework and generalize playlist extractors (#13565)
+ [rutube:playlist] Add support for playlists (#13534, #13565)
+ [radiocanada] Add fallback for title extraction (#14145)
* [vk] Use dedicated YouTube embeds extraction routine
* [vice] Use dedicated YouTube embeds extraction routine
* [cracked] Use dedicated YouTube embeds extraction routine
* [chilloutzone] Use dedicated YouTube embeds extraction routine
* [abcnews] Use dedicated YouTube embeds extraction routine
* [youtube] Separate methods for embeds extraction
* [redtube] Fix formats extraction (#14122)
* [arte] Relax unavailability check (#14112)
+ [manyvids] Add support for preview videos from manyvids.com (#14053, #14059)
* [vidme:user] Relax URL regular expression (#14054)
* [bpb] Fix extraction (#14043, #14086)
* [soundcloud] Fix download URL with private tracks (#14093)
* [aliexpress:live] Add support for live.aliexpress.com (#13698, #13707)
* [viidea] Capture and output lecture error message (#14099)
* [radiocanada] Skip unsupported platforms (#14100)


Sergey M․'s avatar
Sergey M․ committed
479
version 2017.09.02
Sergey M․'s avatar
Sergey M․ committed
480 481 482 483 484 485 486 487 488 489 490 491

Extractors
* [youtube] Force old layout for each webpage (#14068, #14072, #14074, #14076,
  #14077, #14079, #14082, #14083, #14094, #14095, #14096)
* [youtube] Fix upload date extraction (#14065)
+ [charlierose] Add support for episodes (#14062)
+ [bbccouk] Add support for w-prefixed ids (#14056)
* [googledrive] Extend URL regular expression (#9785)
+ [googledrive] Add support for source format (#14046)
* [pornhd] Fix extraction (#14005)


Sergey M․'s avatar
Sergey M․ committed
492
version 2017.08.27.1
Sergey M․'s avatar
Sergey M․ committed
493 494 495 496 497 498

Extractors

* [youtube] Fix extraction with --youtube-skip-dash-manifest enabled (#14037)


Sergey M․'s avatar
Sergey M․ committed
499
version 2017.08.27
Sergey M․'s avatar
Sergey M․ committed
500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518

Core
+ [extractor/common] Extract height and format id for HTML5 videos (#14034)
* [downloader/http] Rework HTTP downloader (#506, #809, #2849, #4240, #6023,
  #8625, #9483)
    * Simplify code and split into separate routines to facilitate maintaining
    * Make retry mechanism work on errors during actual download not only
      during connection establishment phase
    * Retry on ECONNRESET and ETIMEDOUT during reading data from network
    * Retry on content too short
    * Show error description on retry

Extractors
* [generic] Lower preference for extraction from LD-JSON
* [rai] Fix audio formats extraction (#14024)
* [youtube] Fix controversy videos extraction (#14027, #14029)
* [mixcloud] Fix extraction (#14015, #14020)


Sergey M․'s avatar
Sergey M․ committed
519
version 2017.08.23
520 521

Core
Sergey M․'s avatar
Sergey M․ committed
522 523 524
+ [extractor/common] Introduce _parse_xml
* [extractor/common] Make HLS and DASH extraction in_parse_html5_media_entries
  non fatal (#13970)
525 526
* [utils] Fix unescapeHTML for misformed string like "&a&quot;" (#13935)

527
Extractors
Sergey M․'s avatar
Sergey M․ committed
528 529 530 531 532 533
* [cbc:watch] Bypass geo restriction (#13993)
* [toutv] Relax DRM check (#13994)
+ [googledrive] Add support for subtitles (#13619, #13638)
* [pornhub] Relax uploader regular expression (#13906, #13975)
* [bandcamp:album] Extract track titles (#13962)
+ [bbccouk] Add support for events URLs (#13893)
534
+ [liveleak] Support multi-video pages (#6542)
535
+ [liveleak] Support another liveleak embedding pattern (#13336)
Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
536
* [cda] Fix extraction (#13935)
Sergey M․'s avatar
Sergey M․ committed
537 538
+ [laola1tv] Add support for tv.ittf.com (#13965)
* [mixcloud] Fix extraction (#13958, #13974, #13980, #14003)
539

540

Sergey M․'s avatar
Sergey M․ committed
541
version 2017.08.18
542

Sergey M․'s avatar
Sergey M․ committed
543 544 545 546 547
Core
* [YoutubeDL] Sanitize byte string format URLs (#13951)
+ [extractor/common] Add support for float durations in _parse_mpd_formats
  (#13919)

548
Extractors
Sergey M․'s avatar
Sergey M․ committed
549 550 551 552
* [arte] Detect unavailable videos (#13945)
* [generic] Convert redirect URLs to unicode strings (#13951)
* [udemy] Fix paid course detection (#13943)
* [pluralsight] Use RPC API for course extraction (#13937)
553
+ [clippit] Add support for clippituser.tv
554
+ [qqmusic] Support new URL schemes (#13805)
Sergey M․'s avatar
Sergey M․ committed
555 556
* [periscope] Renew HLS extraction (#13917)
* [mixcloud] Extract decrypt key
557 558


Sergey M․'s avatar
Sergey M․ committed
559
version 2017.08.13
Sergey M․'s avatar
Sergey M․ committed
560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577

Core
* [YoutubeDL] Make sure format id is not empty
* [extractor/common] Make _family_friendly_search optional
* [extractor/common] Respect source's type attribute for HTML5 media (#13892)

Extractors
* [pornhub:playlistbase] Skip videos from drop-down menu (#12819, #13902)
+ [fourtube] Add support pornerbros.com (#6022)
+ [fourtube] Add support porntube.com (#7859, #13901)
+ [fourtube] Add support fux.com
* [limelight] Improve embeds detection (#13895)
+ [reddit] Add support for v.redd.it and reddit.com (#13847)
* [aparat] Extract all formats (#13887)
* [mixcloud] Fix play info decryption (#13885)
+ [generic] Add support for vzaar embeds (#13876)


Sergey M․'s avatar
Sergey M․ committed
578
version 2017.08.09
579

Sergey M․'s avatar
Sergey M․ committed
580 581 582
Core
* [utils] Skip missing params in cli_bool_option (#13865)

583
Extractors
Sergey M․'s avatar
Sergey M․ committed
584 585 586 587 588
* [xxxymovies] Fix title extraction (#13868)
+ [nick] Add support for nick.com.pl (#13860)
* [mixcloud] Fix play info decryption (#13867)
* [20min] Fix embeds extraction (#13852)
* [dplayit] Fix extraction (#13851)
589
+ [niconico] Support videos with multiple formats (#13522)
590 591 592
+ [niconico] Support HTML5-only videos (#13806)


Sergey M․'s avatar
Sergey M․ committed
593
version 2017.08.06
Sergey M․'s avatar
Sergey M․ committed
594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614

Core
* Use relative paths for DASH fragments (#12990)

Extractors
* [pluralsight] Fix format selection
- [mpora] Remove extractor (#13826)
+ [voot] Add support for voot.com (#10255, #11644, #11814, #12350, #13218)
* [vlive:channel] Limit number of videos per page to 100 (#13830)
* [podomatic] Extend URL regular expression (#13827)
* [cinchcast] Extend URL regular expression
* [yandexdisk] Relax URL regular expression (#13824)
* [vidme] Extract DASH and HLS formats
- [teamfour] Remove extractor (#13782)
* [pornhd] Fix extraction (#13783)
* [udemy] Fix subtitles extraction (#13812)
* [mlb] Extend URL regular expression (#13740, #13773)
+ [pbs] Add support for new URL schema (#13801)
* [nrktv] Update API host (#13796)


Sergey M․'s avatar
Sergey M․ committed
615
version 2017.07.30.1
616 617

Core
Sergey M․'s avatar
Sergey M․ committed
618
* [downloader/hls] Use redirect URL as manifest base (#13755)
619 620
* [options] Correctly hide login info from debug outputs (#13696)

Sergey M․'s avatar
Sergey M․ committed
621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639
Extractors
+ [watchbox] Add support for watchbox.de (#13739)
- [clipfish] Remove extractor
+ [youjizz] Fix extraction (#13744)
+ [generic] Add support for another ooyala embed pattern (#13727)
+ [ard] Add support for lives (#13771)
* [soundcloud] Update client id
+ [soundcloud:trackstation] Add support for track stations (#13733)
* [svtplay] Use geo verification proxy for API request
* [svtplay] Update API URL (#13767)
+ [yandexdisk] Add support for yadi.sk (#13755)
+ [megaphone] Add support for megaphone.fm
* [amcnetworks] Make rating optional (#12453)
* [cloudy] Fix extraction (#13737)
+ [nickru] Add support for nickelodeon.ru
* [mtv] Improve thumbnal extraction
* [nick] Automate geo-restriction bypass (#13711)
* [niconico] Improve error reporting (#13696)

640

Sergey M․'s avatar
Sergey M․ committed
641
version 2017.07.23
642

Sergey M․'s avatar
Sergey M․ committed
643 644 645 646 647 648
Core
* [YoutubeDL] Improve default format specification (#13704)
* [YoutubeDL] Do not override id, extractor and extractor_key for
  url_transparent entities
* [extractor/common] Fix playlist_from_matches

649
Extractors
Sergey M․'s avatar
Sergey M․ committed
650 651 652 653 654 655 656 657
* [itv] Fix production id extraction (#13671, #13703)
* [vidio] Make duration non fatal and fix typo
* [mtv] Skip missing video parts (#13690)
* [sportbox:embed] Fix extraction
+ [npo] Add support for npo3.nl URLs (#13695)
* [dramafever] Remove video id from title (#13699)
+ [egghead:lesson] Add support for lessons (#6635)
* [funnyordie] Extract more metadata (#13677)
658
* [youku:show] Fix playlist extraction (#13248)
659
+ [dispeak] Recognize sevt subdomain (#13276)
Sergey M․'s avatar
Sergey M․ committed
660
* [adn] Improve error reporting (#13663)
Sergey M․'s avatar
Sergey M․ committed
661
* [crunchyroll] Relax series and season regular expression (#13659)
Sergey M․'s avatar
Sergey M․ committed
662 663 664 665
+ [spiegel:article] Add support for nexx iframe embeds (#13029)
+ [nexx:embed] Add support for iframe embeds
* [nexx] Improve JS embed extraction
+ [pearvideo] Add support for pearvideo.com (#13031)
666 667


Sergey M․'s avatar
Sergey M․ committed
668
version 2017.07.15
669

Sergey M․'s avatar
Sergey M․ committed
670 671 672
Core
* [YoutubeDL] Don't expand environment variables in meta fields (#13637)

673
Extractors
Sergey M․'s avatar
Sergey M․ committed
674 675 676 677 678 679 680 681 682
* [spiegeltv] Delegate extraction to nexx extractor (#13159)
+ [nexx] Add support for nexx.cloud (#10807, #13465)
* [generic] Fix rutube embeds extraction (#13641)
* [karrierevideos] Fix title extraction (#13641)
* [youtube] Don't capture YouTube Red ad for creator meta field (#13621)
* [slideshare] Fix extraction (#13617)
+ [5tv] Add another video URL pattern (#13354, #13606)
* [drtv] Make HLS and HDS extraction non fatal
* [ted] Fix subtitles extraction (#13628, #13629)
683
* [vine] Make sure the title won't be empty
684
+ [twitter] Support HLS streams in vmap URLs
685
+ [periscope] Support pscp.tv URLs in embedded frames
Sergey M․'s avatar
Sergey M․ committed
686
* [twitter] Extract mp4 urls via mobile API (#12726)
687
* [niconico] Fix authentication error handling (#12486)
688
* [giantbomb] Extract m3u8 formats (#13626)
Sergey M․'s avatar
Sergey M․ committed
689
+ [vlive:playlist] Add support for playlists (#13613)
690 691


Sergey M․'s avatar
Sergey M․ committed
692
version 2017.07.09
Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
693

Sergey M․'s avatar
Sergey M․ committed
694 695 696 697
Core
+ [extractor/common] Add support for AMP tags in _parse_html5_media_entries
+ [utils] Support attributes with no values in get_elements_by_attribute

Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
698
Extractors
Sergey M․'s avatar
Sergey M․ committed
699 700 701 702 703 704 705 706 707 708 709
+ [dailymail] Add support for embeds
+ [joj] Add support for joj.sk (#13268)
* [abc.net.au:iview] Extract more formats (#13492, #13489)
* [egghead:course] Fix extraction (#6635, #13370)
+ [cjsw] Add support for cjsw.com (#13525)
+ [eagleplatform] Add support for referrer protected videos (#13557)
+ [eagleplatform] Add support for another embed pattern (#13557)
* [veoh] Extend URL regular expression (#13601)
* [npo:live] Fix live stream id extraction (#13568, #13605)
* [googledrive] Fix height extraction (#13603)
+ [dailymotion] Add support for new layout (#13580)
Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
710
- [yam] Remove extractor
Sergey M․'s avatar
Sergey M․ committed
711 712 713 714 715
* [xhamster] Extract all formats and fix duration extraction (#13593)
+ [xhamster] Add support for new URL schema (#13593)
* [espn] Extend URL regular expression (#13244, #13549)
* [kaltura] Fix typo in subtitles extraction (#13569)
* [vier] Adapt extraction to redesign (#13575)
Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
716 717


Sergey M․'s avatar
Sergey M․ committed
718
version 2017.07.02
719

Sergey M․'s avatar
Sergey M․ committed
720 721 722
Core
* [extractor/common] Improve _json_ld

723
Extractors
Sergey M․'s avatar
Sergey M․ committed
724 725 726 727 728 729 730 731 732 733 734 735 736
+ [thisoldhouse] Add more fallbacks for video id
* [thisoldhouse] Fix video id extraction (#13540, #13541)
* [xfileshare] Extend format regular expression (#13536)
* [ted] Fix extraction (#13535)
+ [tastytrade] Add support for tastytrade.com (#13521)
* [dplayit] Relax video id regular expression (#13524)
+ [generic] Extract more generic metadata (#13527)
+ [bbccouk] Capture and output error message (#13501, #13518)
* [cbsnews] Relax video info regular expression (#13284, #13503)
+ [facebook] Add support for plugin video embeds and multiple embeds (#13493)
* [soundcloud] Switch to https for API requests (#13502)
* [pandatv] Switch to https for API and download URLs
+ [pandatv] Add support for https URLs (#13491)
737 738 739
+ [niconico] Support sp subdomain (#13494)


Sergey M․'s avatar
Sergey M․ committed
740
version 2017.06.25
Sergey M․'s avatar
Sergey M․ committed
741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756

Core
+ [adobepass] Add support for DIRECTV NOW (mso ATTOTT) (#13472)
* [YoutubeDL] Skip malformed formats for better extraction robustness

Extractors
+ [wsj] Add support for barrons.com (#13470)
+ [ign] Add another video id pattern (#13328)
+ [raiplay:live] Add support for live streams (#13414)
+ [redbulltv] Add support for live videos and segments (#13486)
+ [onetpl] Add support for videos embedded via pulsembed (#13482)
* [ooyala] Make more robust
* [ooyala] Skip empty format URLs (#13471, #13476)
* [hgtv.com:show] Fix typo


Sergey M․'s avatar
Sergey M․ committed
757
version 2017.06.23
758

Sergey M․'s avatar
Sergey M․ committed
759 760 761
Core
* [adobepass] Fix extraction on older python 2.6

762
Extractors
Sergey M․'s avatar
Sergey M․ committed
763 764 765 766 767 768 769 770 771 772 773
* [youtube] Adapt to new automatic captions rendition (#13467)
* [hgtv.com:show] Relax video config regular expression (#13279, #13461)
* [drtuber] Fix formats extraction (#12058)
* [youporn] Fix upload date extraction
* [youporn] Improve formats extraction
* [youporn] Fix title extraction (#13456)
* [googledrive] Fix formats sorting (#13443)
* [watchindianporn] Fix extraction (#13411, #13415)
+ [vimeo] Add fallback mp4 extension for original format
+ [ruv] Add support for ruv.is (#13396)
* [viu] Fix extraction on older python 2.6
774
* [pandora.tv] Fix upload_date extraction (#12846)
Sergey M․'s avatar
Sergey M․ committed
775
+ [asiancrush] Add support for asiancrush.com (#13420)
776 777


Sergey M․'s avatar
Sergey M․ committed
778
version 2017.06.18
779

780
Core
Sergey M․'s avatar
Sergey M․ committed
781 782 783 784 785 786
* [downloader/common] Use utils.shell_quote for debug command line
* [utils] Use compat_shlex_quote in shell_quote
* [postprocessor/execafterdownload] Encode command line (#13407)
* [compat] Fix compat_shlex_quote on Windows (#5889, #10254)
* [postprocessor/metadatafromtitle] Fix missing optional meta fields processing
   in --metadata-from-title (#13408)
787
* [extractor/common] Fix json dumping with --geo-bypass
Sergey M․'s avatar
Sergey M․ committed
788 789
+ [extractor/common] Improve jwplayer subtitles extraction
+ [extractor/common] Improve jwplayer formats extraction (#13379)
790

791
Extractors
Sergey M․'s avatar
Sergey M․ committed
792 793
* [polskieradio] Fix extraction (#13392)
+ [xfileshare] Add support for fastvideo.me (#13385)
794
* [bilibili] Fix extraction of videos with double quotes in titles (#13387)
Sergey M․'s avatar
Sergey M․ committed
795 796 797 798 799
* [4tube] Fix extraction (#13381, #13382)
+ [disney] Add support for disneychannel.de (#13383)
* [npo] Improve URL regular expression (#13376)
+ [corus] Add support for showcase.ca
+ [corus] Add support for history.ca (#13359)
800 801


Sergey M․'s avatar
Sergey M․ committed
802
version 2017.06.12
Sergey M․'s avatar
Sergey M․ committed
803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834

Core
* [utils] Handle compat_HTMLParseError in extract_attributes (#13349)
+ [compat] Introduce compat_HTMLParseError
* [utils] Improve unified_timestamp
* [extractor/generic] Ensure format id is unicode string
* [extractor/common] Return unicode string from _match_id
+ [YoutubeDL] Sanitize more fields (#13313)

Extractors
+ [xfileshare] Add support for rapidvideo.tv (#13348)
* [xfileshare] Modernize and pass Referer
+ [rutv] Add support for testplayer.vgtrk.com (#13347)
+ [newgrounds] Extract more metadata (#13232)
+ [newgrounds:playlist] Add support for playlists (#10611)
* [newgrounds] Improve formats and uploader extraction (#13346)
* [msn] Fix formats extraction
* [turbo] Ensure format id is string
* [sexu] Ensure height is int
* [jove] Ensure comment count is int
* [golem] Ensure format id is string
* [gfycat] Ensure filesize is int
* [foxgay] Ensure height is int
* [flickr] Ensure format id is string
* [sohu] Fix numeric fields
* [safari] Improve authentication detection (#13319)
* [liveleak] Ensure height is int (#13313)
* [streamango] Make title optional (#13292)
* [rtlnl] Improve URL regular expression (#13295)
* [tvplayer] Fix extraction (#13291)


Sergey M․'s avatar
Sergey M․ committed
835
version 2017.06.05
Sergey M․'s avatar
Sergey M․ committed
836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851

Core
* [YoutubeDL] Don't emit ANSI escape codes on Windows (#13270)

Extractors
+ [bandcamp:weekly] Add support for bandcamp weekly (#12758)
* [pornhub:playlist] Fix extraction (#13281)
- [godtv] Remove extractor (#13175)
* [safari] Fix typo (#13252)
* [youtube] Improve chapters extraction (#13247)
* [1tv] Lower preference for HTTP formats (#13246)
* [francetv] Relax URL regular expression
* [drbonanza] Fix extraction (#13231)
* [packtpub] Fix authentication (#13240)


Sergey M․'s avatar
Sergey M․ committed
852
version 2017.05.29
853 854

Extractors
855 856
* [youtube] Fix DASH MPD extraction for videos with non-encrypted format URLs
  (#13211)
Sergey M․'s avatar
Sergey M․ committed
857 858 859 860 861 862 863 864 865 866
* [xhamster] Fix uploader and like/dislike count extraction (#13216))
+ [xhamster] Extract categories (#11728)
+ [abcnews] Add support for embed URLs (#12851)
* [gaskrank] Fix extraction (#12493)
* [medialaan] Fix videos with missing videoUrl (#12774)
* [dvtv] Fix playlist support
+ [dvtv] Add support for DASH and HLS formats (#3063)
+ [beam:vod] Add support for beam.pro/mixer.com VODs (#13032))
* [cbsinteractive] Relax URL regular expression (#13213)
* [adn] Fix formats extraction
867
+ [youku] Extract more metadata (#10433)
Sergey M․'s avatar
Sergey M․ committed
868
* [cbsnews] Fix extraction (#13205)
869 870


Sergey M․'s avatar
Sergey M․ committed
871
version 2017.05.26
872 873

Core
874
+ [utils] strip_jsonp() can recognize more patterns
875 876
* [postprocessor/ffmpeg] Fix metadata filename handling on Python 2 (#13182)

877
Extractors
878
+ [youtube] DASH MPDs with cipher signatures are recognized now (#11381)
Sergey M․'s avatar
Sergey M․ committed
879
+ [bbc] Add support for authentication
880
* [tudou] Merge into youku extractor (#12214)
Yen Chi Hsuan's avatar
Yen Chi Hsuan committed
881
* [youku:show] Fix extraction
882
* [youku] Fix extraction (#13191)
Sergey M․'s avatar
Sergey M․ committed
883 884 885
* [udemy] Fix extraction for outputs' format entries without URL (#13192)
* [vimeo] Fix formats' sorting (#13189)
* [cbsnews] Fix extraction for 60 Minutes videos (#12861)
886

887

Sergey M․'s avatar
Sergey M․ committed
888
version 2017.05.23
Sergey M․'s avatar
Sergey M․ committed
889 890 891 892 893 894 895 896 897 898 899 900 901 902 903

Core
+ [downloader/external] Pass -loglevel to ffmpeg downloader (#13183)
+ [adobepass] Add support for Bright House Networks (#13149)

Extractors
+ [streamcz] Add support for subtitles (#13174)
* [youtube] Fix DASH manifest signature decryption (#8944, #13156)
* [toggle] Relax URL regular expression (#13172)
* [toypics] Fix extraction (#13077)
* [njpwworld] Fix extraction (#13162, #13169)
+ [hitbox] Add support for smashcast.tv (#13154)
* [mitele] Update app key regular expression (#13158)


Sergey M․'s avatar
Sergey M․ committed
904
version 2017.05.18.1
Sergey M․'s avatar
Sergey M․ committed
905 906 907 908 909

Core
* [jsinterp] Fix typo and cleanup regular expressions (#13134)


Sergey M․'s avatar
Sergey M․ committed
910
version 2017.05.18
Sergey M․'s avatar
Sergey M․ committed
911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928

Core
+ [jsinterp] Add support for quoted names and indexers (#13123, #13124, #13125,
  #13126, #13128, #13129, #13130, #13131, #13132)
+ [extractor/common] Add support for schemeless URLs in _extract_wowza_formats
  (#13088, #13092)
+ [utils] Recognize more audio codecs (#13081)

Extractors
+ [vier] Extract more metadata (#12539)
* [vier] Improve extraction (#12801)
    + Add support for authentication
    * Bypass authentication when no credentials provided
    * Improve extraction robustness
* [dailymail] Fix sources extraction (#13057)
* [dailymotion] Extend URL regular expression (#13079)


Sergey M․'s avatar
Sergey M․ committed
929
version 2017.05.14
930

Sergey M․'s avatar
Sergey M․ committed
931 932 933 934 935
Core
+ [extractor/common] Respect Width and Height attributes in ISM manifests
+ [postprocessor/metadatafromtitle] Add support regular expression syntax for
  --metadata-from-title (#13065)

Sergey M․'s avatar
Sergey M․ committed
936
Extractors
Sergey M․'s avatar
Sergey M․ committed
937 938 939 940 941 942 943 944
+ [mediaset] Add support for video.mediaset.it (#12708, #12964)
* [orf:radio] Fix extraction (#11643, #12926)
* [aljazeera] Extend URL regular expression (#13053)
* [imdb] Relax URL regular expression (#13056)
+ [francetv] Add support for mobile.france.tv (#13068)
+ [upskill] Add support for upskillcourses.com (#13043)
* [thescene] Fix extraction (#13061)
* [condenast] Improve embed support
945
* [liveleak] Fix extraction (#12053)
946
+ [douyu] Support Douyu shows (#12228)
Sergey M․'s avatar
Sergey M․ committed
947 948
* [myspace] Improve URL regular expression (#13040)
* [adultswim] Use desktop platform in assets URL (#13041)
949 950


Sergey M․'s avatar
Sergey M․ committed
951
version 2017.05.09
Sergey M․'s avatar
Sergey M․ committed
952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973

Core
* [YoutubeDL] Force --restrict-filenames when no locale is set on all python
  versions (#13027)

Extractors
* [francetv] Adapt to site redesign (#13034)
+ [packtpub] Add support for authentication (#12622)
* [drtv] Lower preference for SignLanguage formats (#13013, #13016)
+ [cspan] Add support for brightcove live embeds (#13028)
* [vrv] Extract DASH formats and subtitles
* [funimation] Fix authentication (#13021)
* [adultswim] Fix extraction (#8640, #10950, #11042, #12121)
    + Add support for Adobe Pass authentication
    + Add support for live streams
    + Add support for show pages
* [turner] Extract thumbnail, is_live and strip description
+ [nonktube] Add support for nonktube.com (#8647, #13024)
+ [nuevo] Pass headers to _extract_nuevo
* [nbc] Improve extraction (#12364)


Sergey M․'s avatar
Sergey M․ committed
974
version 2017.05.07
975

Sergey M․'s avatar
Sergey M․ committed
976 977 978 979 980
Common
* [extractor/common] Fix typo in _extract_akamai_formats
+ [postprocessor/ffmpeg] Embed chapters into media file with --add-metadata
+ [extractor/common] Introduce chapters meta field

981
Extractors
Sergey M․'s avatar
Sergey M․ committed
982 983
* [youtube] Fix authentication (#12820, #12927, #12973, #12992, #12993, #12995,
  #13003)
984
* [bilibili] Fix video downloading (#13001)
Sergey M․'s avatar
Sergey M․ committed
985 986 987 988 989 990 991
* [rmcdecouverte] Fix extraction (#12937)
* [theplatform] Extract chapters
* [bandcamp] Fix thumbnail extraction (#12980)
* [pornhub] Extend URL regular expression (#12996)
+ [youtube] Extract chapters
+ [nrk] Extract chapters
+ [vice] Add support for ooyala embeds in article pages
992
+ [vice] Support vice articles (#12968)
993
* [vice] Fix extraction for non en_us videos (#12967)
994
* [gdcvault] Fix extraction for some videos (#12733)
Sergey M․'s avatar
Sergey M․ committed
995 996
* [pbs] Improve multipart video support (#12981)
* [laola1tv] Fix extraction (#12880)
997
+ [cda] Support birthday verification (#12789)
998
* [leeco] Fix extraction (#12974)
Sergey M․'s avatar
Sergey M․ committed
999 1000 1001 1002
+ [pbs] Extract chapters
* [amp] Imporove thumbnail and subtitles extraction
* [foxsports] Fix extraction (#12945)
- [coub] Remove comment count extraction (#12941)
1003 1004


Sergey M․'s avatar
Sergey M․ committed
1005
version 2017.05.01
1006

Sergey M․'s avatar
Sergey M․ committed
1007 1008 1009 1010 1011 1012 1013 1014
Core
+ [extractor/common] Extract view count from JSON-LD
* [utils] Improve unified_timestamp
+ [utils] Add video/mp2t to mimetype2ext
* [downloader/external] Properly handle live stream downloading cancellation
  (#8932)
+ [utils] Add support for unicode whitespace in clean_html on python 2 (#12906)

1015
Extractors
Sergey M․'s avatar
Sergey M․ committed
1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028
* [infoq] Make audio format extraction non fatal (#12938)
* [brightcove] Allow whitespace around attribute names in embedded code
+ [zaq1] Add support for zaq1.pl (#12693)
+ [xvideos] Extract duration (#12828)
* [vevo] Fix extraction (#12879)
+ [noovo] Add support for noovo.ca (#12792)
+ [washingtonpost] Add support for embeds (#12699)
* [yandexmusic:playlist] Fix extraction for python 3 (#12888)
* [anvato] Improve extraction (#12913)
    * Promote to regular shortcut based extractor
    * Add mcp to access key mapping table
    * Add support for embeds extraction
    * Add support for anvato embeds in generic extractor
1029
* [xtube] Fix extraction for older FLV videos (#12734)
Sergey M․'s avatar
Sergey M․ committed
1030
* [tvplayer] Fix extraction (#12908)
1031 1032


Sergey M․'s avatar
Sergey M․ committed
1033
version 2017.04.28
1034

Sergey M․'s avatar
Sergey M․ committed
1035 1036 1037 1038 1039 1040 1041 1042
Core
+ [adobepass] Use geo verification headers for all requests
- [downloader/fragment] Remove assert for resume_len when no fragments
  downloaded
+ [extractor/common] Add manifest_url for explicit group rendition formats
* [extractor/common] Fix manifest_url for m3u8 formats
- [extractor/common] Don't list master m3u8 playlists in format list (#12832)

1043
Extractor
Sergey M․'s avatar
Sergey M․ committed
1044 1045
* [aenetworks] Fix extraction for shows with single season
+ [go] Add support for Disney, DisneyJunior and DisneyXD show pages
1046
* [youtube] Recognize new locale-based player URLs (#12885)
Sergey M․'s avatar
Sergey M․ committed
1047 1048
+ [streamable] Add support for new embedded URL schema (#12844)
* [arte:+7] Relax URL regular expression (#12837)
1049 1050


Sergey M․'s avatar
Sergey M․ committed
1051
version 2017.04.26
1052

1053
Core
Sergey M․'s avatar
Sergey M․ committed
1054 1055 1056
* Introduce --keep-fragments for keeping fragments of fragmented download
  on disk after download is finished
* [YoutubeDL] Fix output template for missing timestamp (#12796)
1057
* [socks] Handle cases where credentials are required but missing
Sergey M․'s avatar
Sergey M․ committed
1058
* [extractor/common] Improve HLS extraction (#12211)
Sergey M․'s avatar
Sergey M․ committed
1059 1060 1061 1062 1063
    * Extract m3u8 parsing to separate method
    * Improve rendition groups extraction
    * Build stream name according stream GROUP-ID
    * Ignore reference to AUDIO group without URI when stream has no CODECS
    * Use float for scaled tbr in _parse_m3u8_formats
Sergey M․'s avatar
Sergey M․ committed
1064 1065 1066 1067
* [utils] Add support for TTML styles in dfxp2srt
* [downloader/hls] No need to download keys for fragments that have been
  already downloaded
* [downloader/fragment] Improve fragment downloading
Sergey M․'s avatar
Sergey M․ committed
1068 1069 1070 1071
    * Resume immediately
    * Don't concatenate fragments and decrypt them on every resume
    * Optimize disk storage usage, don't store intermediate fragments on disk
    * Store bookkeeping download state file
Sergey M․'s avatar
Sergey M․ committed
1072 1073 1074 1075 1076
+ [extractor/common] Add support for multiple getters in try_get
+ [extractor/common] Add support for video of WebPage context in _json_ld
  (#12778)
+ [extractor/common] Relax JWPlayer regular expression and remove
  duplicate URLs (#12768)
1077

1078
Extractors
1079
* [iqiyi] Fix extraction of Yule videos
Sergey M․'s avatar
Sergey M․ committed
1080 1081
* [vidio] Improve extraction and sort formats
+ [brightcove] Match only video elements with data-video-id attribute
1082
* [iqiyi] Fix playlist detection (#12504)
1083
- [azubu] Remove extractor (#12813)
1084
* [porn91] Fix extraction (#12814)
Sergey M․'s avatar
Sergey M․ committed
1085 1086 1087 1088
* [vidzi] Fix extraction (#12793)
+ [amp] Extract error message (#12795)
+ [xfileshare] Add support for gorillavid.com and daclips.com (#12776)
* [instagram] Fix extraction (#12777)
1089 1090
+ [generic] Support Brightcove videos in <iframe> (#12482)
+ [brightcove] Support URLs with bcpid instead of playerID (#12482)
Sergey M․'s avatar
Sergey M․ committed
1091 1092
* [brightcove] Fix _extract_url (#12782)
+ [odnoklassniki] Extract HLS formats
1093 1094


Sergey M․'s avatar
Sergey M․ committed
1095
version 2017.04.17
Sergey M․'s avatar
Sergey M․ committed
1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107

Extractors
* [limelight] Improve extraction LimelightEmbeddedPlayerFlash media embeds and
  add support for channel and channelList embeds
* [generic] Extract multiple Limelight embeds (#12761)
+ [itv] Extract series metadata
* [itv] Fix RTMP formats downloading (#12759)
* [itv] Use native HLS downloader by default
+ [go90] Extract subtitles (#12752)
+ [go90] Extract series metadata (#12752)


Sergey M․'s avatar
Sergey M․ committed
1108
version 2017.04.16
Sergey M․'s avatar
Sergey M․ committed
1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123

Core
* [YoutubeDL] Apply expand_path after output template substitution
+ [YoutubeDL] Propagate overridden meta fields to extraction results of type
  url (#11163)

Extractors
+ [generic] Extract RSS entries as url_transparent (#11163)
+ [streamango] Add support for streamango.com (#12643)
+ [wsj:article] Add support for articles (#12558)
* [brightcove] Relax video tag embeds extraction and validate ambiguous embeds'
  URLs (#9163, #12005, #12178, #12480)
+ [udemy] Add support for react rendition (#12744)


Sergey M․'s avatar
Sergey M․ committed
1124
version 2017.04.15
Sergey M․'s avatar
Sergey M․ committed
1125 1126 1127 1128 1129

Extractors
* [youku] Fix fileid extraction (#12741, #12743)


Sergey M․'s avatar
Sergey M․ committed
1130
version 2017.04.14
Sergey M․'s avatar
Sergey M․ committed
1131 1132 1133

Core
+ [downloader/hls] Add basic support for EXT-X-BYTERANGE tag (#10955)
Felix Yan's avatar
Felix Yan committed
1134
+ [adobepass] Improve Comcast and Verizon login code (#10803)
Sergey M․'s avatar
Sergey M․ committed
1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149
+ [adobepass] Add support for Verizon (#10803)

Extractors
+ [aenetworks] Add support for specials (#12723)
+ [hbo] Extract HLS formats
+ [go90] Add support for go90.com (#10127)
+ [tv2hu] Add support for tv2.hu (#10509)
+ [generic] Exclude URLs with xml ext from valid video URLs (#10768, #11654)
* [youtube] Improve HLS formats extraction
* [afreecatv] Fix extraction for videos with different key layout (#12718)
- [youtube] Remove explicit preference for audio-only and video-only formats in
  order not to break sorting when new formats appear
* [canalplus] Bypass geo restriction


Sergey M․'s avatar
Sergey M․ committed
1150
version 2017.04.11
Sergey M․'s avatar
Sergey M․ committed
1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162

Extractors
* [afreecatv] Fix extraction (#12706)
+ [generic] Add support for <object> YouTube embeds (#12637)
* [bbccouk] Treat bitrate as audio+video bitrate in media selector
+ [bbccouk] Skip unrecognized formats in media selector (#12701)
+ [bbccouk] Add support for https protocol in media selector (#12701)
* [curiositystream] Fix extraction (#12638)
* [adn] Update subtitle decryption key
* [chaturbate] Fix extraction (#12665, #12688, #12690)


Sergey M․'s avatar
Sergey M․ committed
1163
version 2017.04.09
1164 1165

Extractors
Sergey M․'s avatar
Sergey M․ committed
1166 1167 1168 1169 1170 1171 1172 1173
+ [medici] Add support for medici.tv (#3406)
+ [rbmaradio] Add support for redbullradio.com URLs (#12687)
+ [npo:live] Add support for default URL (#12555)
* [mixcloud:playlist] Fix title, description and view count extraction (#12582)
+ [thesun] Add suport for thesun.co.uk (#11298, #12674)
+ [ceskateleveize:porady] Add support for porady (#7411, #12645)
* [ceskateleveize] Improve extraction and remove URL replacement hacks
+ [kaltura] Add support for iframe embeds (#12679)
1174
* [airmozilla] Fix extraction (#12670)
Sergey M․'s avatar
Sergey M․ committed
1175 1176 1177 1178 1179 1180 1181 1182
* [wshh] Extract html5 entries and delegate to generic extractor (12676)
+ [raiplay] Extract subtitles
+ [xfileshare] Add support for vidlo.us (#12660)
+ [xfileshare] Add support for vidbom.com (#12661)
+ [aenetworks] Add more video URL regular expressions (#12657)
+ [odnoklassniki] Fix format sorting for 1080p quality
+ [rtl2] Add support for you.rtl2.de (#10257)
+ [vshare] Add support for vshare.io (#12278)
1183 1184


Sergey M․'s avatar
Sergey M․ committed
1185
version 2017.04.03
Sergey M․'s avatar
Sergey M․ committed
1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196

Core
+ [extractor/common] Add censorship check for TransTelekom ISP
* [extractor/common] Move censorship checks to a separate method

Extractors
+ [discoveryvr] Add support for discoveryvr.com (#12578)
+ [tv5mondeplus] Add support for tv5mondeplus.com (#11386)
+ [periscope] Add support for pscp.tv URLs (#12618, #12625)


Sergey M․'s avatar
Sergey M․ committed
1197
version 2017.04.02
Sergey M․'s avatar
Sergey M․ committed
1198 1199

Core
Sergey M․'s avatar
Sergey M․ committed
1200
* [YoutubeDL] Return early when extraction of url_transparent fails
Sergey M․'s avatar
Sergey M․ committed
1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220

Extractors
* [rai] Fix and improve extraction (#11790)
+ [vrv] Add support for series pages
* [limelight] Improve extraction for audio only formats
* [funimation] Fix extraction (#10696, #11773)
+ [xfileshare] Add support for vidabc.com (#12589)
+ [xfileshare] Improve extraction and extract hls formats
+ [crunchyroll] Pass geo verifcation proxy
+ [cwtv] Extract ISM formats
+ [tvplay] Bypass geo restriction
+ [vrv] Add support for vrv.co
+ [packtpub] Add support for packtpub.com (#12610)
+ [generic] Pass base_url to _parse_jwplayer_data
+ [adn] Add support for animedigitalnetwork.fr (#4866)
+ [allocine] Extract more metadata
* [allocine] Fix extraction (#12592)
* [openload] Fix extraction


Sergey M․'s avatar
Sergey M․ committed
1221
version 2017.03.26
1222

1223 1224
Core
* Don't raise an error if JWPlayer config data is not a Javascript object
Sergey M․'s avatar
Sergey M․ committed
1225 1226 1227 1228
  literal. _find_jwplayer_data now returns a dict rather than an str. (#12307)
* Expand environment variables for options representing paths (#12556)
+ [utils] Introduce expand_path
* [downloader/hls] Delegate downloading to ffmpeg immediately for live streams
1229

1230 1231
Extractors
* [afreecatv] Fix extraction (#12179)
Sergey M․'s avatar
Sergey M․ committed
1232 1233 1234 1235 1236 1237 1238 1239
+ [atvat] Add support for atv.at (#5325)
+ [fox] Add metadata extraction (#12391)
+ [atresplayer] Extract DASH formats
+ [atresplayer] Extract HD manifest (#12548)
* [atresplayer] Fix login error detection (#12548)
* [franceculture] Fix extraction (#12547)
* [youtube] Improve URL regular expression (#12538)
* [generic] Do not follow redirects to the same URL
1240 1241


Sergey M․'s avatar
Sergey M․ committed
1242
version 2017.03.24
Sergey M․'s avatar
Sergey M․ committed
1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253

Extractors
- [9c9media] Remove mp4 URL extraction request
+ [bellmedia] Add support for etalk.ca and space.ca (#12447)
* [channel9] Fix extraction (#11323)
* [cloudy] Fix extraction (#12525)
+ [hbo] Add support for free episode URLs and new formats extraction (#12519)
* [condenast] Fix extraction and style (#12526)
* [viu] Relax URL regular expression (#12529)


Sergey M․'s avatar
Sergey M․ committed
1254
version 2017.03.22
Sergey M․'s avatar
Sergey M․ committed
1255 1256 1257 1258 1259 1260 1261

Extractors
- [pluralsight] Omit module title from video title (#12506)
* [pornhub] Decode obfuscated video URL (#12470, #12515)
* [senateisvp] Allow https URL scheme for embeds (#12512)


Sergey M․'s avatar
Sergey M․ committed
1262
version 2017.03.20
1263

Sergey M․'s avatar
Sergey M․ committed
1264 1265 1266 1267 1268
Core
+ [YoutubeDL] Allow multiple input URLs to be used with stdout (-) as
  output template
+ [adobepass] Detect and output error on authz token extraction (#12472)

1269
Extractors
1270
+ [bostonglobe] Add extractor for bostonglobe.com (#12099)
Sergey M․'s avatar
Sergey M․ committed
1271 1272 1273
+ [toongoggles] Add support for toongoggles.com (#12171)
+ [medialaan] Add support for Medialaan sites (#9974, #11912)
+ [discoverynetworks] Add support for more domains and bypass geo restiction
1274 1275 1276
* [openload] Fix extraction (#10408)


Sergey M․'s avatar
Sergey M․ committed
1277
version 2017.03.16
Sergey M․'s avatar
Sergey M․ committed
1278 1279 1280 1281 1282 1283 1284 1285 1286 1287

Core
+ [postprocessor/ffmpeg] Add support for flac
+ [extractor/common] Extract SMIL formats from jwplayer

Extractors
+ [generic] Add forgotten return for jwplayer formats
* [redbulltv] Improve extraction


Sergey M․'s avatar
Sergey M․ committed
1288
version 2017.03.15
1289 1290 1291 1292

Core
* Fix missing subtitles if --add-metadata is used (#12423)

Sergey M․'s avatar
Sergey M․ committed