안녕하세요 딥러닝 논문읽기 모임 입니다!

논문 발표자료 : https://www2.slideshare.net/taeseonryu/explaining-knowledge-distillation
지금까지 업데이트 된 논문 리뷰 영상 : https://github.com/Lilcob/-DL_PaperReadingMeeting
딥논읽 채널 : https://www.youtube.com/channel/UCDULrK2OJsiDhFroa2Aj_LQ?view_as=subscriber

오늘 업데이트된 따끈따근한 논문 리뷰 영상은
'Explaining Knowledge Distillation by Quantifying the Knowledge'
라는 제목의 논문입니다 해당논문은 2020 cvpr에서 프로시딩된 논문입니다!
해당논문은 DNN의 인풋 이후 메인 태스크와 관련이 있는 이미지와 관련이 없는 이미지의 feature를 찾아내어 시각적으로 정량화하고 분석하여 knowledge distillation을 성공적으로 수행하는방법을 제시합니다! 또한 해당논문은 세가지의 가설을 제시하여 논문의 메소드에대한 설명을 보다 탄탄하게 뒷받침 하는대요,
펀디멘탈팀의 김동희님이 자세한 논문 리뷰를 도와주셨습니다!
오늘도 많은 관심 감사드립니다!
https://youtu.be/3q3iHhgKOY0

6 free, high-quality Udemy courses for you today:

Python
https://www.udemy.com/course/python-comprehensive-bootcamp-beginner-to-professional/?ranMID=39197&ranEAID=WIRXHBzeZwo&ranSiteID=WIRXHBzeZwo-NFnZtLOHl0lU6RYjRtpMdA&LSNPUBID=WIRXHBzeZwo&utm_source=aff-campaign&utm_medium=udemyads&couponCode=25D2E97D660C1C362067

Deep Learning - Python & R
https://www.udemy.com/course/deep-learning-with-keras-and-tensorflow-in-python-and-r/?ranMID=39197&ranEAID=WIRXHBzeZwo&ranSiteID=WIRXHBzeZwo-NFnZtLOHl0lU6RYjRtpMdA&LSNPUBID=WIRXHBzeZwo&utm_source=aff-campaign&utm_medium=udemyads&couponCode=DECOUP20

Data viz in Excel
https://www.udemy.com/course/data-visualization-in-excel-for-business-professionals/?ranMID=39197&ranEAID=WIRXHBzeZwo&ranSiteID=WIRXHBzeZwo-NFnZtLOHl0lU6RYjRtpMdA&LSNPUBID=WIRXHBzeZwo&utm_source=aff-campaign&utm_medium=udemyads&couponCode=DECOUP20

Statistics/Probability
https://www.udemy.com/course/probability-and-statistics-1-the-complete-guide/?ranMID=39197&ranEAID=WIRXHBzeZwo&ranSiteID=WIRXHBzeZwo-NFnZtLOHl0lU6RYjRtpMdA&LSNPUBID=WIRXHBzeZwo&utm_source=aff-campaign&utm_medium=udemyads&couponCode=6F666FD4D86872974BA9

R
https://www.udemy.com/course/data-manipulation-with-dplyr-in-r/?ranMID=39197&ranEAID=WIRXHBzeZwo&ranSiteID=WIRXHBzeZwo-NFnZtLOHl0lU6RYjRtpMdA&LSNPUBID=WIRXHBzeZwo&utm_source=aff-campaign&utm_medium=udemyads&couponCode=MATURITY

mySQL
https://www.udemy.com/course/the-complete-sql-course-2020-become-a-mysql-master/?couponCode=SQLCOURSE29

phi(z) = 1 / (1 + e^-(alpha + beta*z)) 일 때 다양한 alpha, beta에 따른 logistic function plot.

import matplotlib.pyplot as plt
import numpy as np

def sigmoid1(x, alpha, beta):
    return 1.0 / (1.0 + np.exp(-(alpha + beta*x)))
z = np.arange(-7, 7, 0.1)
# phi_z = sigmoid1(alpha=3, beta=2, z)
c0 = [sigmoid1(x, alpha=0, beta=1) for x in z]
plt.plot(z, c0, label='alpha=0, beta=1', linestyle='--')
c1 = [sigmoid1(x, alpha=1, beta=1) for x in z]
plt.plot(z, c1, label='alpha=1, beta=1')
c2 = [sigmoid1(x, alpha=1, beta=2) for x in z]
plt.plot(z, c2, label='alpha=1, beta=2')
c3 = [sigmoid1(x, alpha=0, beta=2) for x in z]
plt.plot(z, c3, label='alpha=0, beta=2')
plt.axvline(0.0, color='k')
plt.ylim(-0.1, 1.1)
plt.xlabel('z')
plt.ylabel('$\phi (z)$')
# y축의 눈금과 격자선
plt.yticks([0.0, 0.5, 1.0])
ax = plt.gca()
ax.yaxis.grid(True)
plt.legend(loc='best')
plt.tight_layout()
plt.show()

Cheat sheet for python Neural network Machine Learning Data Science for newbies ALL PDF.https://bit.ly/394jjDH

lsjsj92.tistory.com/529

How can we improve coding skill??

https://www.facebook.com/groups/AnalyticsEdge/permalink/2810677495813871/

Practice one hour every day..Read documentation.

Top 13 YouTube Channels to Learn Data Science


Get started

Open in app



497K Followers

·

About

Follow

Responses

To respond to this story,
get the free Medium app.

Open in app

There are currently no responses for this story.

Be the first to respond.

You have 2 free member-only stories left this month. 

Sign up for Medium and get an extra one

Top 13 YouTube Channels to Learn Data Science

Informative channels on YouTube to gain access to tons of informative videos on Data Science



Claire D. Costa

Nov 9·12 min read





Photo by freestocks.org from Pexels

Data science is the discipline of making data useful.

YouTube doesn’t need much of an introduction, and we’re sure you all know how much of a popular platform it is among people of all age groups. YouTube is not just a vast repository of entertainment, but it is also an equally important source of education. Undeniably the best thing about learning from YouTube is the lack of any fee or charges for getting access to that vast repertoire of educational videos.
Data Science and many other domains like it can seem daunting at first, but with YouTube, you can get easy access to a plethora of educational and instructional videos on a wealth of topics, including Data Science. The goal behind this write-up is to introduce you to a range of informative channels on YouTube that demystify the complex concepts of Data Science so that you can learn at your own pace. But before digging into this, check out
Some Interesting Articles for Data Science —

Data Science Books You Must Read in 2020

Have a look, why you should read them?

towardsdatascience.com

Best Data Science Blogs to Follow in 2020

Most trusted and reputed sources to update yourself with the latest happenings in the Data Science world.

towardsdatascience.com

10 Popular Data Science Resources on Github

Some of the top GitHub repositories that will teach you all about Data Science.

towardsdatascience.com

Top Data Science YouTube Channels

The domain of Data Science brings with itself a variety of scientific tools, processes, algorithms, and knowledge extraction systems from structured and unstructured data alike, for identifying meaningful patterns in it.

Everybody loves YouTube, right? But wouldn’t it be fun to gain access to literally thousands of informative videos on Data Science, covering not just the basics but also the latest happenings in the domain?
In the age of Massive Online Open Courses(MOOCs), YouTube serves as a powerful platform to find answers to your questions, which otherwise would not have made it to the course video. All that while helping you save some money.
We’re guessing by now you’re pretty hyped to know about the channels, fair enough, let’s not waste any more time and move on to the list of YouTube channels focused on Data Science.

1. 3Blue1Brown





Source: 3Blue1Brown

Since: Mar 4, 2015

Creator: Grant Sanderson

Views: 165,573,366

Subscribers: 3.22M

Youtube Link: https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw

3Blue1Brown is a fairly enjoyable channel created by Grant Sanderson in March 2015 that primarily focuses on teaching math in an entertaining way.
You might be wondering why we included this channel in our list. Well, there are two reasons for that. First, he addresses a multitude of topics on his channel that are related to the Data Science domain. Some of these topics include Neural Networks, Linear Algebra, Fourier Transformations, Calculus, and many others.
Second, the amazing visualizations you see in his videos have been created by an animation engine in Python called manim, which Grant created by himself. The channel 3Blue1Brown has over 100 uploads with a total of 165 million views.
Throughout his channel, you’ll realize how much of an important role the visualizations play in Grant’s videos and how beautifully the manim library can be utilized to create some slick visuals.

2. freeCodeCamp.org





Source: freeCodeCamp.org

Since: Dec 17, 2014

Creator: Quincy Larson

Views: 127,751,078

Subscribers: 2.72M

Youtube Link: https://www.youtube.com/c/Freecodecamp/featured

Website: https://www.freecodecamp.org/

Created by Quincy Larson in December 2014, freeCodeCamp is a non-profit organization with a mission to empower people to code and help others. freeCodeCamp is more of a course-oriented channel run by a highly knowledgeable group of people with a strong background in programming. Their YouTube channel offers informative videos on a wide range of topics, such as Data Structures, JavaScript, Python, Data Science, Machine Learning, Node.js, and has upwards of 127 million total views so far.
freeCodeCamp’s channel has over 1100 videos, and a decent chunk of them are full-on courses with over an hour of content and code sessions at the very least. You can also visit their website to get your hands on more than 6000 tutorials on programming and ethical hacking.

3. Sentdex





Source: Sentdex

Since: Dec 17, 2012

Creator: Harrison Kinsley

Views: 87,960,317

Subscribers: 974K

Youtube Link: https://www.youtube.com/c/sentdex/features

Website: https://pythonprogramming.net/

Created by Harrison Kinsley in December 2012, Sentdex covers several programming topics and technologies such as Machine Learning, Natural Language Processing, Data Analysis and Visualization, and some Robotics projects with Raspberry Pi projects.
Harrison’s clear and explanatory style of simplifying the various topics puts Sentdex among the best Data Science channels on YouTube. The channel has over 1200 videos and more than 87 million views. Harrison’s love for Python can be seen on his channel, as he has covered a multitude of programming topics in Python.
He also runs a website called Python Programming Tutorials, where you can find a healthy collection of Python projects in a very detailed manner and see how things work. If you’re interested in a more advanced topic, say, Neural Networks, Harrison has written a book on it called “Neural Networks from Scratch in Python”.
Some Interesting Articles related to Python —

Best Python IDEs and Code Editors You Must Use in 2020

Top Python IDEs and Code Editors with noteworthy features

towardsdatascience.com

10 Cool Python Project Ideas for Python Developers

A list of interesting ideas and projects you can build using Python

towardsdatascience.com

Python Books You Must Read in 2020

Have a look, why you should read them?

towardsdatascience.com

4. Corey Schafer





Source: Corey Schafer

Since: Jun 1, 2006

Creator: Corey Schafer

Views: 47,336,678

Subscribers: 661K

Youtube: https://www.youtube.com/c/Coreyms/featured

Website: http://coreyms.com/

Corey Schafer’s YouTube channel revolves mainly around programming tools that are vital for modern programmers and researchers, including the fundamental concepts of programming. The videos on Corey’s channel have garnered over 47 million views and counting. The channel has covered a range of topics, such as the basics of programming, Linux tutorials, SQL tutorials, Django, and much more.
For individuals interested in Data Science, Corey has got you covered with video playlists on topics like Pandas, Matplotlib, and a series of videos on getting started Python. Whether you’re a veteran in programming in a professional environment or a beginner learning about the technology, Corey has offered educational content keeping everyone’s skill level in mind.

5. Tech With Tim





Source: Tech With Tim

Since: Apr 23, 2014

Creator: Tim Ruscica

Views: 32,827,834

Subscribers: 466K

Youtube Link: https://www.youtube.com/c/TechWithTim/featured

Website: https://www.techwithtim.net/

Started by Tim Ruscica in April 2014, the videos on Tim’s channel are more focused on Python programming in general with some game development using PyGame, some tutorials on Machine Learning, and JavaScript paired with a few frameworks. With over 32 million total views, Tim’s channel has some cool projects on a couple of topics, such as a Flappy Bird game, a Face Recognition tool, a Slack bot, and more.
Tim has also done a handful of long coding live streams ranging anywhere from a manageable period of 2 hours to more grueling 12-hour sessions. You will also find some crucial tips and advice on his channel for new developers as well as some programming project ideas, along with some beginner-friendly tutorials on Golang and Flutter. If you like the projects on Tim’s channel, you can find the code on his GitHub repo to follow through with some of his videos.

6. Python Programmer





Source: Giles McMullen

Since: Aug 16, 2008

Creator: Giles McMullen

Views: 7,440,604

Subscribers: 229K

Youtube Link: https://www.youtube.com/c/FlickThrough/featured

Giles McMullen created this channel in August 2008 to inspire the world about Python and to show his love for the programming language, hence the name Python Programmer. Throughout the years, Giles covered loads of tutorials on his channel for various topics ranging from the more fundamental ones for beginners like the basics of Python programming to more advanced topics, like Data Science and Machine Learning.
You can find a few free courses on Giles’ channel for Data Science and Machine Learning, which can essentially give you a strong idea about the core concepts in these subjects. Apart from covering educational topics, Giles also has videos about popular Python libraries, such as Pandas, NumPy, Scikit-learn, and some handy tips to programmers of all skills on the hows and whats of Python or just programming in general.

7. StatQuest With Josh Starmer





Source: StatQuest

Since: May 24, 2011

Views: 17,551,985

Subscribers: 371K

Youtube Link: https://www.youtube.com/c/joshstarmer/featured

Website: https://statquest.org/

What started as mere explanations about the complex statistical techniques to colleagues at work soon turned into Josh’s passion and later into StatQuest. StatQuest takes away the challenges people usually face in understanding those complicated terms and methods that modern statistics and Machine Learning is filled with.
Created by Josh Starmer in May 2011, StatQuest has more than 180 videos with a combined total of 17 million views. In the channel, you will find a handful of playlists explaining the various fundamental concepts like Logistic Regression, Linear Regression, Linear Models. You can also visit StatQuest’s website to find study guides filled with detailed information for a better understanding of sub-topics like AdaBoost, Classification Trees, and a few others.

8. Krish Naik





https://youtu.be/MMQjmeTmoxQ 

최재식 교수님께서 설명가능한 AI(딥러닝)에 관한 여러 모델을 알기 쉽게 말씀해 주셨습니다.

www.programcreek.com/python/example/98358/youtube_dl.YoutubeDL

Python youtube_dl.YoutubeDL() Examples

The following are 30 code examples for showing how to use youtube_dl.YoutubeDL(). These examples are extracted from open source projects. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example.

You may check out the related API usage on the sidebar.

You may also want to check out all available functions/classes of the module youtube_dl , or try the search function 

 .

Example 1

def download_clip(url, name): ydl_opts = { 'format': 'bestaudio/best', 'outtmpl': dir_utils.get_perm_med_dir() + f'/sound_board/{name}.wav', 'noplaylist': True, 'continue_dl': True, 'postprocessors': [{ 'key': 'FFmpegExtractAudio', 'preferredcodec': 'wav', 'preferredquality': '192', }] } try: with youtube_dl.YoutubeDL(ydl_opts) as ydl: ydl.cache.remove() info_dict = ydl.extract_info(url, download=False) ydl.prepare_filename(info_dict) ydl.download([url]) return True except Exception: return False

Example 2

def extract_video_highres(self): if not YoutubeDL: raise ModuleNotFoundError( "youtube-dl must be installed to download videos in high resolution." ) ydl_opts = { 'format': 'best', 'quiet': True, } try: post_id = self.post.get('post_id') video_page = 'https://www.facebook.com/' + post_id with YoutubeDL(ydl_opts) as ydl: url = ydl.extract_info(video_page, download=False)['url'] return {'video': url} except ExtractorError as ex: logger.error("Error extracting video with youtube-dl: %r", ex) return None

Example 3

def download_song_name(url): try: with youtube_dl.YoutubeDL(YoutubeHelper.ydl_opts) as ydl: ydl.cache.remove() info_dict = ydl.extract_info(url, download=True) if info_dict['duration'] >= YoutubeHelper.max_track_duration: return None if info_dict['duration'] <= 0.1: return None prep_struct = { 'std_url': url, 'main_url': info_dict['url'], 'main_title': info_dict['title'], 'img_id': info_dict['id'], 'duration': info_dict['duration'] } return prep_struct except youtube_dl.utils.DownloadError: return None

Example 4

def download_next(): queue_list = list(YoutubeHelper.queue_instance.queue_storage) if len(queue_list) > 0: youtube_url = queue_list[-1]['std_url'] else: return if os.path.exists(f"{dir_utils.get_temp_med_dir()}/youtube/{queue_list[-1]['img_id']}.jpg"): dprint(f"Thumbnail exists for {queue_list[-1]['img_id']}.jpg...skipping") return try: with youtube_dl.YoutubeDL(YoutubeHelper.ydl_opts) as ydl: ydl.cache.remove() ydl.extract_info(youtube_url, download=True) except youtube_dl.utils.DownloadError as e: dprint(e) return return

Example 5

def setUp(self): super().setUp() try: # try to find out whether youtube is happy with us this time # send a request and skip the test if there is an error ydl_opts = Youtube.get_ydl_opts() ydl_opts["logger"] = YoutubeDLLogger(self) with youtube_dl.YoutubeDL(ydl_opts) as ydl: self.info_dict = ydl.download( ["https://www.youtube.com/watch?v=wobbf3lb2nk"] ) except (youtube_dl.utils.ExtractorError, youtube_dl.utils.DownloadError) as e: self.skipTest(f"Error when interacting with youtube, skipping test: {e}") # reduce the number for youtube playlists self.client.post(reverse("set_max_playlist_items"), {"value": "3"}) # clear test cache; ensure that it's the test directory if os.path.split(os.path.dirname(settings.SONGS_CACHE_DIR))[1] == "test_cache": for member in os.listdir(settings.SONGS_CACHE_DIR): member_path = os.path.join(settings.SONGS_CACHE_DIR, member) if os.path.isfile(member_path): os.remove(member_path)

Example 6

def check_available(self) -> bool: try: with youtube_dl.YoutubeDL(self.ydl_opts) as ydl: self.info_dict = ydl.extract_info(self.query, download=False) except (youtube_dl.utils.ExtractorError, youtube_dl.utils.DownloadError) as e: self.error = e return False # this value is not an exact match, but it's a good approximation if "entries" in self.info_dict: self.info_dict = self.info_dict["entries"][0] self.id = self.info_dict["id"] size = self.info_dict["filesize"] max_size = self.musiq.base.settings.basic.max_download_size * 1024 * 1024 if ( max_size != 0 and self.check_cached() is None and (size is not None and size > max_size) ): self.error = "Song too long" return False return True

Example 7

def return_youtubevideo_params(url): """ returns Youtube Video parameters(FPS, dimensions) directly using Youtube-dl """ ydl = youtube_dl.YoutubeDL( { "outtmpl": "%(id)s%(ext)s", "noplaylist": True, "quiet": True, "format": "bestvideo", } ) with ydl: result = ydl.extract_info( url, download=False ) # We just want to extract the info return (int(result["width"]), int(result["height"]), float(result["fps"]))

Example 8

def download_song(song_url, song_title): """ Download a song using youtube url and song title """ outtmpl = song_title + '.%(ext)s' ydl_opts = { 'format': 'bestaudio/best', 'outtmpl': outtmpl, 'postprocessors': [ {'key': 'FFmpegExtractAudio','preferredcodec': 'mp3', 'preferredquality': '192', }, {'key': 'FFmpegMetadata'}, ], } with youtube_dl.YoutubeDL(ydl_opts) as ydl: info_dict = ydl.extract_info(song_url, download=True)

Example 9

def download(self): ydl_options = self._prepare_ytd_options() with youtube_dl.YoutubeDL(ydl_options) as ydl: ydl.add_default_info_extractors() ydl.add_progress_hook(self.hook) try: ydl.download([self.url]) except ( youtube_dl.utils.DownloadError, youtube_dl.utils.ContentTooShortError, youtube_dl.utils.ExtractorError, youtube_dl.utils.UnavailableVideoError ) as e: self.error_occurred = True self.remove_row_signal.emit() self.remove_url_signal.emit(self.url) self.status_bar_signal.emit(str(e))

Example 10

def download_song(song_url, song_title): ''' Downloads song from youtube-dl ''' outtmpl = song_title + '.%(ext)s' ydl_opts = { 'format': 'bestaudio/best', 'outtmpl': outtmpl, 'postprocessors': [{ 'key': 'FFmpegExtractAudio', 'preferredcodec': 'mp3', 'preferredquality': '192', }, {'key': 'FFmpegMetadata'}, ], } with youtube_dl.YoutubeDL(ydl_opts) as ydl: info_dict = ydl.extract_info(song_url, download=True)

Example 11

def list_formats(info_dict: dict) -> str: """YoutubeDL's list_formats method but without format notes. Args: info_dict (``dict``): Dictionary which is returned by YoutubeDL's extract_info method. Returns: ``str``: All available formats in order as a string instead of stdout. """ formats = info_dict.get('formats', [info_dict]) table = [ [f['format_id'], f['ext'], youtube_dl.YoutubeDL.format_resolution(f)] for f in formats if f.get('preference') is None or f['preference'] >= -1000] if len(formats) > 1: table[-1][-1] += (' ' if table[-1][-1] else '') + '(best)' header_line = ['format code', 'extension', 'resolution'] fmtStr = ( '`Available formats for %s:`\n`%s`' % (info_dict['title'], youtube_dl.render_table(header_line, table)) ) return fmtStr

Example 12

def shouldUseYoutubeDl(url): for siteMask in youtubeDlSitesSupported: if siteMask in url: isBlacklisted = False for blacklistSite in youtubeDlBlacklistSites: if blacklistSite in url: isBlacklisted = True break # Use the gfycat api for these, if available # Ever since the creation of RedGifs, use YoutubeDL for all gfycat links... # if settings.settings['Gfycat_Client_id'] and 'gfycat.com' in url: # isBlacklisted = True if isBlacklisted: # We probably have another downloader return False # YoutubeDL should support this site return True return False # Returns (success or failure, output file or failure message)

Example 13

def __init__(self, requester, item_info): """ :param requester: The user that queued the item. :type requester: discord.Member :param item_info: Document containing the queued item's details. :type item_info: dict """ self.requester = requester self.item_info = item_info self.url = self.item_info.get('webpage_url') self.video_id = self.item_info.get('id', self.url) self.uploader = self.item_info.get('uploader', 'Unknown') self.title = self.item_info.get('title') self.thumbnail = self.item_info.get('thumbnail', 'https://i.imgur.com/CGPNJDT.png') self.duration = int(self.item_info.get('duration', 0)) self.downloaded = False self.loop = asyncio.get_event_loop() self.threads = ThreadPoolExecutor() self.ytdl_params = ytdl_params self.ytdl = youtube_dl.YoutubeDL(self.ytdl_params) self.token = self.tokenize() self.location = None

Example 14

def _get_info_from_url(self): self.log.info("url: fetching metadata of url %s " % self.url) ydl_opts = { 'noplaylist': True } succeed = False with youtube_dl.YoutubeDL(ydl_opts) as ydl: attempts = var.config.getint('bot', 'download_attempts', fallback=2) for i in range(attempts): try: info = ydl.extract_info(self.url, download=False) self.duration = info['duration'] self.title = info['title'] self.keywords = info['title'] succeed = True return True except youtube_dl.utils.DownloadError: pass except KeyError: # info has no 'duration' break if not succeed: self.ready = 'failed' self.log.error("url: error while fetching info from the URL") raise ValidationFailedError(constants.strings('unable_download', item=self.format_title()))

Example 15

def videoDownloader(string, passedTitle, yearVar): # Options for the video downloader ydl1_opts = { 'outtmpl': os.path.join(TheaterTrailersHome, 'Trailers', '{0} ({1})'.format(passedTitle, yearVar), '{0} ({1}).mp4'.format(passedTitle, yearVar)), 'ignoreerrors': True, 'format': 'bestvideo[ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', } with youtube_dl.YoutubeDL(ydl1_opts) as ydl: logger.info("downloading {0} from {1}".format(passedTitle, string)) ydl.download([string]) shutil.copy2( os.path.join(trailerLocation, '{0} ({1})'.format(passedTitle, yearVar), '{0} ({1}).mp4'.format(passedTitle, yearVar)), os.path.join(trailerLocation, '{0} ({1})'.format(passedTitle, yearVar), '{0} ({1})-trailer.mp4'.format(passedTitle, yearVar)) ) shutil.copy2( os.path.join(TheaterTrailersHome, 'res', 'poster.jpg'), os.path.join(trailerLocation, '{0} ({1})'.format(passedTitle, yearVar)) ) updatePlex() # Downloads info for the videos from the playlist

Example 16

def run(self): self.intercept_ydl_opts() with YoutubeDL(self.ydl_opts) as ydl: try: if self.first_run: info_dict = ydl.extract_info(self.url, download=False) # self.logger.debug(json.dumps(info_dict, indent=4)) info_dict['description'] = info_dict['description'].replace('\n', '<br />'); payload = {'tid': self.tid, 'data': info_dict} self.msg_cli.put('info_dict', payload) self.logger.info('start downloading, url - %s' %(self.url)) ydl.download([self.url]) except DownloadError as e: # url error event_handler = FatalEvent(self.tid, self.msg_cli) event_handler.invalid_url(self.url); self.msg_cli.put('worker_done', {'tid': self.tid, 'data': {}})

Example 17

def list_formats(info_dict: dict) -> str: """YoutubeDL's list_formats method but without format notes. Args: info_dict (``dict``): Dictionary which is returned by YoutubeDL's extract_info method. Returns: ``str``: All available formats in order as a string instead of stdout. """ formats = info_dict.get('formats', [info_dict]) table = [[ f['format_id'], f['ext'], youtube_dl.YoutubeDL.format_resolution(f) ] for f in formats if f.get('preference') is None or f['preference'] >= -1000] if len(formats) > 1: table[-1][-1] += (' ' if table[-1][-1] else '') + '(best)' header_line = ['format code', 'extension', 'resolution'] fmtStr = ( '`Available formats for %s:`\n`%s`' % (info_dict['title'], youtube_dl.render_table(header_line, table))) return fmtStr

Example 18

def __init__(self, job): DownloaderBase.__init__(self, job) extractor = job.extractor retries = self.config("retries", extractor._retries) options = { "format": self.config("format") or None, "ratelimit": text.parse_bytes(self.config("rate"), None), "retries": retries+1 if retries >= 0 else float("inf"), "socket_timeout": self.config("timeout", extractor._timeout), "nocheckcertificate": not self.config("verify", extractor._verify), "nopart": not self.part, "updatetime": self.config("mtime", True), "proxy": extractor.session.proxies.get("http"), } options.update(self.config("raw-options") or {}) if self.config("logging", True): options["logger"] = self.log self.forward_cookies = self.config("forward-cookies", False) outtmpl = self.config("outtmpl") self.outtmpl = DEFAULT_OUTTMPL if outtmpl == "default" else outtmpl self.ytdl = YoutubeDL(options)

Example 19

def get_videos(url): """Download all videos in the course. """ # Lynda.com login and video filename options options = { 'username': USERNAME, 'password': PASSWORD, 'outtmpl': u'%(playlist_index)s-%(title)s.%(ext)s', 'writesubtitles': SUBTITLES, 'allsubtitles': SUBTITLES, 'download_archive': ARCHIVE, 'external_downloader': EXTERNAL_DL } try: with youtube_dl.YoutubeDL(options) as ydl: ydl.download([url]) except: print('Could not download the video in course: {}'.format(url))

Example 20

def downloadURL(url, preferredCodec=None, preferredQuality=None): """ Downloads song using youtube_dl and the song's youtube url. """ codec, quality = getCodecAndQuality() ydl_opts = { 'format': 'bestaudio/best', 'quiet': True, 'no_warnings': True, 'postprocessors': [{ 'key': 'FFmpegExtractAudio', 'preferredcodec': codec, 'preferredquality': quality, }, {'key': 'FFmpegMetadata'}, ], } try: with YoutubeDL(ydl_opts) as ydl: return ydl.extract_info(url, download=True) except: print("Problem downloading " + url) return None

Example 21

def download(title, video_url): ydl_opts = { 'outtmpl': '{}.%(ext)s'.format(title), 'format': 'bestaudio/best', 'postprocessors': [{ 'key': 'FFmpegExtractAudio', 'preferredcodec': 'mp3', 'preferredquality': '192', }], } with youtube_dl.YoutubeDL(ydl_opts) as ydl: ydl.download([video_url]) return { 'audio': open(title + '.mp3', 'rb'), 'title': title, }

Example 22

def test_create_basenames_from_ydl_info_dict_playlist(self): ydl = YoutubeDL() result = self.tu.create_basenames_from_ydl_info_dict( ydl, info_dict_playlist) expected_result = set([ 'Live Streaming Rafid Aslam-7gjgkH5iPaE', 'Live Streaming Rafid Aslam-q92kxPm-pqM', 'Cara Membuat Laptop Menjadi Hotspot WiFi Dengan CMD-YjFwMSDNphM', '[CSO] Defeat Boss in Dead End With Thanatos 7-EEm6MwXLse0', 'Cara Bermain Minecraft Multiplayer Dengan LAN-g2vTZ2ka-tM', 'Live Streaming Rafid Aslam-AXhuSS5_9YU', 'Cara Membuat Disk Baru di Komputer-KDOygJnK7Sw', 'Cara Mendownload Lewat Torrent-cC-9RghkvXs'] ) self.assertEqual(result, expected_result)

Example 23

def determine_max_video_res(item, save_dir): if 'files' in item: if 'mp4_1080' in item['files']: return item['files']['mp4_1080'] if 'mp4_720' in item['files']: return item['files']['mp4_720'] if 'mp4_480' in item['files']: return item['files']['mp4_480'] if 'mp4_360' in item['files']: return item['files']['mp4_360'] if 'mp4_240' in item['files']: return item['files']['mp4_240'] elif 'player' in item: # TODO: parse VK videos here to download user-owned private files ydl_opts = { 'outtmpl': save_dir + '/%(title)s.%(ext)s', 'noplaylist': True, 'logger': VkScraper.VideoLogger(), } with youtube_dl.YoutubeDL(ydl_opts) as ydl: ydl.download([item['player']])

Example 24

def download(self,filename,directory,url): ydl_opts = { "format": "best", "outtmpl": str(directory / (filename + ".%(ext)s")), "progress_hooks": [self._hook], "playlistend": 1, "nooverwrites": True, "quiet": True } with youtube_dl.YoutubeDL(ydl_opts) as ydl: ydl.download([url]) location = directory/(filename+".mp4") if GLOBAL.arguments.no_dupes: try: fileHash = createHash(location) except FileNotFoundError: return None if fileHash in GLOBAL.downloadedPosts(): os.remove(location) raise FileAlreadyExistsError GLOBAL.downloadedPosts.add(fileHash)

Example 25

def do_extract_url(url): """Extract a video url.""" params = { 'format': 'bestvideo+bestaudio/best', 'outtmpl': '/dev/null', 'writedescription': True, 'writeinfojson': True, 'writesubtitles': False, 'subtitlesformat': 'srt/ass/vtt/best', 'cachedir': '/tmp/', 'noplaylist': True, # not implemented in video2commons } info = youtube_dl.YoutubeDL(params).extract_info(url, download=False) assert 'formats' in info or info.get('direct'), \ 'Your url cannot be processed correctly' ie_key = info['extractor_key'] title = (info.get('title') or '').strip() url = info.get('webpage_url') or url filedesc = FILEDESC_TEMPLATE % { 'desc': _desc(url, ie_key, title, info), 'date': _date(url, ie_key, title, info), 'source': _source(url, ie_key, title, info), 'uploader': _uploader(url, ie_key, title, info), 'license': _license(url, ie_key, title, info) } return { 'url': url, 'extractor': ie_key, 'filedesc': filedesc.strip(), 'filename': sanitize(title) }

Example 26

def get(self,q): if "http" in q.lower(): u=q.strip() else: u='https://www.youtube.com/watch?v='+q y = yt.YoutubeDL() return y.extract_info(u, download=False)

Example 27

def download_specific(index): queue_list = list(YoutubeHelper.queue_instance.queue_storage) if len(queue_list) > 0: youtube_url = queue_list[index]['std_url'] else: return if os.path.isfile(f"{dir_utils.get_temp_med_dir()}/youtube/{queue_list[index]['img_id']}.jpg"): return try: with youtube_dl.YoutubeDL(YoutubeHelper.ydl_opts) as ydl: ydl.extract_info(youtube_url, download=True) except youtube_dl.utils.DownloadError: return return

Example 28

def _download(self) -> bool: error = None location = None try: with youtube_dl.YoutubeDL(self.ydl_opts) as ydl: ydl.download([self.get_external_url()]) location = self._get_path() base = os.path.splitext(location)[0] thumbnail = base + ".jpg" try: os.remove(thumbnail) except FileNotFoundError: logging.info("tried to delete %s but does not exist", thumbnail) try: # tag the file with replaygain to perform volume normalization subprocess.call( ["rganalysis", location], stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, ) except OSError as e: if e.errno == errno.ENOENT: pass # the rganalysis package was not found. Skip normalization else: raise except youtube_dl.utils.DownloadError as e: error = e if error is not None or location is None: logging.error("accessible video could not be downloaded: %s", self.id) logging.error("location: %s", location) logging.error(error) return False return True

Example 29

def fetch_metadata(self) -> bool: # in case of a radio playist, restrict the number of songs that are downloaded if self.is_radio(): self.ydl_opts[ "playlistend" ] = self.musiq.base.settings.basic.max_playlist_items try: with youtube_dl.YoutubeDL(self.ydl_opts) as ydl: info_dict = ydl.extract_info(self.id, download=False) except (youtube_dl.utils.ExtractorError, youtube_dl.utils.DownloadError) as e: self.error = e return False if info_dict["_type"] != "playlist" or "entries" not in info_dict: # query was not a playlist url -> search for the query assert False assert self.id == info_dict["id"] if "title" in info_dict: self.title = info_dict["title"] for entry in info_dict["entries"]: self.urls.append("https://www.youtube.com/watch?v=" + entry["id"]) assert self.key is None return True

Example 30

def __init__(self, video_url, device_info=None, ytdl_options=None, throw_ytdl_dl_errs=False): self._throw_ytdl_dl_errs = throw_ytdl_dl_errs self.local_ip = get_local_ip(device_info.ip) if device_info else None self.port = random.randrange(45000, 47000) if device_info else None if "://" in video_url: self._ydl = youtube_dl.YoutubeDL(dict(ytdl_options) if ytdl_options else DEFAULT_YTDL_OPTS) self._preinfo = self._get_stream_preinfo(video_url) # Some playlist urls needs to be re-processed (such as youtube channel urls). if self._preinfo.get("ie_key"): self._preinfo = self._get_stream_preinfo(self._preinfo["url"]) self.is_local_file = False model = (device_info.manufacturer, device_info.model_name) if device_info else None cast_type = device_info.cast_type if device_info else None if "format" in self._ydl.params: # We pop the "format" item, as it will make get_stream_info fail, # if it holds an invalid value. self._best_format = self._ydl.params.pop("format") elif cast_type and cast_type in AUDIO_DEVICE_TYPES: self._best_format = AUDIO_FORMAT elif model and model in ULTRA_MODELS: self._best_format = ULTRA_FORMAT else: self._best_format = STANDARD_FORMAT if self.is_playlist: self._entries = list(self._preinfo["entries"]) # There appears to be no way to extract both a YouTube video id, # and ditto playlist id in one go (in the case of an url containing both), # so we set the "noplaylist" option and then fetch preinfo again. self._ydl.params.update({"noplaylist": True}) vpreinfo = self._get_stream_preinfo(video_url) self._info = self._get_stream_info(vpreinfo) if "entries" not in vpreinfo else None else: self._info = self._get_stream_info(self._preinfo) else: self._local_file = video_url self.is_local_file = True

gitee.com/superxiaoqiang/youtube-dl#embedding-youtube-dl

youtube-dl - download videos from youtube.com or other video platforms

• INSTALLATION
• DESCRIPTION
• OPTIONS
• CONFIGURATION
• OUTPUT TEMPLATE
• FORMAT SELECTION
• VIDEO SELECTION
• FAQ
• DEVELOPER INSTRUCTIONS
• EMBEDDING YOUTUBE-DL
• BUGS
• COPYRIGHT

INSTALLATION

To install it right away for all UNIX users (Linux, OS X, etc.), type:

sudo curl https://yt-dl.org/latest/youtube-dl -o /usr/local/bin/youtube-dl sudo chmod a+rx /usr/local/bin/youtube-dl

If you do not have curl, you can alternatively use a recent wget:

sudo wget https://yt-dl.org/downloads/latest/youtube-dl -O /usr/local/bin/youtube-dl sudo chmod a+rx /usr/local/bin/youtube-dl

Windows users can download a .exe file and place it in their home directory or any other location on their PATH.

OS X users can install youtube-dl with Homebrew.

brew install youtube-dl

You can also use pip:

sudo pip install youtube-dl

Alternatively, refer to the developer instructions for how to check out and work with the git repository. For further options, including PGP signatures, see https://rg3.github.io/youtube-dl/download.html .

DESCRIPTION

youtube-dl is a small command-line program to download videos from YouTube.com and a few more sites. It requires the Python interpreter, version 2.6, 2.7, or 3.2+, and it is not platform specific. It should work on your Unix box, on Windows or on Mac OS X. It is released to the public domain, which means you can modify it, redistribute it or use it however you like.

youtube-dl [OPTIONS] URL [URL...]

OPTIONS

-h, --help Print this help text and exit --version Print program version and exit -U, --update Update this program to latest version. Make sure that you have sufficient permissions (run with sudo if needed) -i, --ignore-errors Continue on download errors, for example to skip unavailable videos in a playlist --abort-on-error Abort downloading of further videos (in the playlist or the command line) if an error occurs --dump-user-agent Display the current browser identification --list-extractors List all supported extractors --extractor-descriptions Output descriptions of all supported extractors --force-generic-extractor Force extraction to use the generic extractor --default-search PREFIX Use this prefix for unqualified URLs. For example "gvsearch2:" downloads two videos from google videos for youtube-dl "large apple". Use the value "auto" to let youtube-dl guess ("auto_warning" to emit a warning when guessing). "error" just throws an error. The default value "fixup_error" repairs broken URLs, but emits an error if this is not possible instead of searching. --ignore-config Do not read configuration files. When given in the global configuration file /etc/youtube-dl.conf: Do not read the user configuration in ~/.config/youtube-dl/config (%APPDATA%/youtube-dl/config.txt on Windows) --flat-playlist Do not extract the videos of a playlist, only list them. --no-color Do not emit color codes in output

Network Options:

--proxy URL Use the specified HTTP/HTTPS proxy. Pass in an empty string (--proxy "") for direct connection --socket-timeout SECONDS Time to wait before giving up, in seconds --source-address IP Client-side IP address to bind to (experimental) -4, --force-ipv4 Make all connections via IPv4 (experimental) -6, --force-ipv6 Make all connections via IPv6 (experimental) --cn-verification-proxy URL Use this proxy to verify the IP address for some Chinese sites. The default proxy specified by --proxy (or none, if the options is not present) is used for the actual downloading. (experimental)

Video Selection:

--playlist-start NUMBER Playlist video to start at (default is 1) --playlist-end NUMBER Playlist video to end at (default is last) --playlist-items ITEM_SPEC Playlist video items to download. Specify indices of the videos in the playlist separated by commas like: "--playlist-items 1,2,5,8" if you want to download videos indexed 1, 2, 5, 8 in the playlist. You can specify range: "--playlist-items 1-3,7,10-13", it will download the videos at index 1, 2, 3, 7, 10, 11, 12 and 13. --match-title REGEX Download only matching titles (regex or caseless sub-string) --reject-title REGEX Skip download for matching titles (regex or caseless sub-string) --max-downloads NUMBER Abort after downloading NUMBER files --min-filesize SIZE Do not download any videos smaller than SIZE (e.g. 50k or 44.6m) --max-filesize SIZE Do not download any videos larger than SIZE (e.g. 50k or 44.6m) --date DATE Download only videos uploaded in this date --datebefore DATE Download only videos uploaded on or before this date (i.e. inclusive) --dateafter DATE Download only videos uploaded on or after this date (i.e. inclusive) --min-views COUNT Do not download any videos with less than COUNT views --max-views COUNT Do not download any videos with more than COUNT views --match-filter FILTER Generic video filter (experimental). Specify any key (see help for -o for a list of available keys) to match if the key is present, !key to check if the key is not present,key > NUMBER (like "comment_count > 12", also works with >=, <, <=, !=, =) to compare against a number, and & to require multiple matches. Values which are not known are excluded unless you put a question mark (?) after the operator.For example, to only match videos that have been liked more than 100 times and disliked less than 50 times (or the dislike functionality is not available at the given service), but who also have a description, use --match-filter "like_count > 100 & dislike_count <? 50 & description" . --no-playlist Download only the video, if the URL refers to a video and a playlist. --yes-playlist Download the playlist, if the URL refers to a video and a playlist. --age-limit YEARS Download only videos suitable for the given age --download-archive FILE Download only videos not listed in the archive file. Record the IDs of all downloaded videos in it. --include-ads Download advertisements as well (experimental)

Download Options:

-r, --rate-limit LIMIT Maximum download rate in bytes per second (e.g. 50K or 4.2M) -R, --retries RETRIES Number of retries (default is 10), or "infinite". --buffer-size SIZE Size of download buffer (e.g. 1024 or 16K) (default is 1024) --no-resize-buffer Do not automatically adjust the buffer size. By default, the buffer size is automatically resized from an initial value of SIZE. --playlist-reverse Download playlist videos in reverse order --xattr-set-filesize Set file xattribute ytdl.filesize with expected filesize (experimental) --hls-prefer-native Use the native HLS downloader instead of ffmpeg (experimental) --external-downloader COMMAND Use the specified external downloader. Currently supports aria2c,axel,curl,httpie,wget --external-downloader-args ARGS Give these arguments to the external downloader

Filesystem Options:

-a, --batch-file FILE File containing URLs to download ('-' for stdin) --id Use only video ID in file name -o, --output TEMPLATE Output filename template. Use %(title)s to get the title, %(uploader)s for the uploader name, %(uploader_id)s for the uploader nickname if different, %(autonumber)s to get an automatically incremented number, %(ext)s for the filename extension, %(format)s for the format description (like "22 - 1280x720" or "HD"), %(format_id)s for the unique id of the format (like YouTube's itags: "137"), %(upload_date)s for the upload date (YYYYMMDD), %(extractor)s for the provider (youtube, metacafe, etc), %(id)s for the video id, %(playlist_title)s, %(playlist_id)s, or %(playlist)s (=title if present, ID otherwise) for the playlist the video is in, %(playlist_index)s for the position in the playlist. %(height)s and %(width)s for the width and height of the video format. %(resolution)s for a textual description of the resolution of the video format. %% for a literal percent. Use - to output to stdout. Can also be used to download to a different directory, for example with -o '/my/downloads/%(uploader)s/%(title)s-%(id)s.%(ext)s' . --autonumber-size NUMBER Specify the number of digits in %(autonumber)s when it is present in output filename template or --auto-number option is given --restrict-filenames Restrict filenames to only ASCII characters, and avoid "&" and spaces in filenames -A, --auto-number [deprecated; use -o "%(autonumber)s-%(title)s.%(ext)s" ] Number downloaded files starting from 00000 -t, --title [deprecated] Use title in file name (default) -l, --literal [deprecated] Alias of --title -w, --no-overwrites Do not overwrite files -c, --continue Force resume of partially downloaded files. By default, youtube-dl will resume downloads if possible. --no-continue Do not resume partially downloaded files (restart from beginning) --no-part Do not use .part files - write directly into output file --no-mtime Do not use the Last-modified header to set the file modification time --write-description Write video description to a .description file --write-info-json Write video metadata to a .info.json file --write-annotations Write video annotations to a .annotations.xml file --load-info FILE JSON file containing the video information (created with the "--write-info-json" option) --cookies FILE File to read cookies from and dump cookie jar in --cache-dir DIR Location in the filesystem where youtube-dl can store some downloaded information permanently. By default $XDG_CACHE_HOME/youtube-dl or ~/.cache/youtube-dl . At the moment, only YouTube player files (for videos with obfuscated signatures) are cached, but that may change. --no-cache-dir Disable filesystem caching --rm-cache-dir Delete all filesystem cache files

Thumbnail images:

--write-thumbnail Write thumbnail image to disk --write-all-thumbnails Write all thumbnail image formats to disk --list-thumbnails Simulate and list all available thumbnail formats

Verbosity / Simulation Options:

-q, --quiet Activate quiet mode --no-warnings Ignore warnings -s, --simulate Do not download the video and do not write anything to disk --skip-download Do not download the video -g, --get-url Simulate, quiet but print URL -e, --get-title Simulate, quiet but print title --get-id Simulate, quiet but print id --get-thumbnail Simulate, quiet but print thumbnail URL --get-description Simulate, quiet but print video description --get-duration Simulate, quiet but print video length --get-filename Simulate, quiet but print output filename --get-format Simulate, quiet but print output format -j, --dump-json Simulate, quiet but print JSON information. See --output for a description of available keys. -J, --dump-single-json Simulate, quiet but print JSON information for each command-line argument. If the URL refers to a playlist, dump the whole playlist information in a single line. --print-json Be quiet and print the video information as JSON (video is still being downloaded). --newline Output progress bar as new lines --no-progress Do not print progress bar --console-title Display progress in console titlebar -v, --verbose Print various debugging information --dump-pages Print downloaded pages encoded using base64 to debug problems (very verbose) --write-pages Write downloaded intermediary pages to files in the current directory to debug problems --print-traffic Display sent and read HTTP traffic -C, --call-home Contact the youtube-dl server for debugging --no-call-home Do NOT contact the youtube-dl server for debugging

Workarounds:

--encoding ENCODING Force the specified encoding (experimental) --no-check-certificate Suppress HTTPS certificate validation --prefer-insecure Use an unencrypted connection to retrieve information about the video. (Currently supported only for YouTube) --user-agent UA Specify a custom user agent --referer URL Specify a custom referer, use if the video access is restricted to one domain --add-header FIELD:VALUE Specify a custom HTTP header and its value, separated by a colon ':'. You can use this option multiple times --bidi-workaround Work around terminals that lack bidirectional text support. Requires bidiv or fribidi executable in PATH --sleep-interval SECONDS Number of seconds to sleep before each download.

Video Format Options:

-f, --format FORMAT Video format code, see the "FORMAT SELECTION" for all the info --all-formats Download all available video formats --prefer-free-formats Prefer free video formats unless a specific one is requested -F, --list-formats List all available formats --youtube-skip-dash-manifest Do not download the DASH manifests and related data on YouTube videos --merge-output-format FORMAT If a merge is required (e.g. bestvideo+bestaudio), output to given container format. One of mkv, mp4, ogg, webm, flv. Ignored if no merge is required

Subtitle Options:

--write-sub Write subtitle file --write-auto-sub Write automatic subtitle file (YouTube only) --all-subs Download all the available subtitles of the video --list-subs List all available subtitles for the video --sub-format FORMAT Subtitle format, accepts formats preference, for example: "srt" or "ass/srt/best" --sub-lang LANGS Languages of the subtitles to download (optional) separated by commas, use IETF language tags like 'en,pt'

Authentication Options:

-u, --username USERNAME Login with this account ID -p, --password PASSWORD Account password. If this option is left out, youtube-dl will ask interactively. -2, --twofactor TWOFACTOR Two-factor auth code -n, --netrc Use .netrc authentication data --video-password PASSWORD Video password (vimeo, smotri, youku)

Post-processing Options:

-x, --extract-audio Convert video files to audio-only files (requires ffmpeg or avconv and ffprobe or avprobe) --audio-format FORMAT Specify audio format: "best", "aac", "vorbis", "mp3", "m4a", "opus", or "wav"; "best" by default --audio-quality QUALITY Specify ffmpeg/avconv audio quality, insert a value between 0 (better) and 9 (worse) for VBR or a specific bitrate like 128K (default 5) --recode-video FORMAT Encode the video to another format if necessary (currently supported: mp4|flv|ogg|webm|mkv|avi) --postprocessor-args ARGS Give these arguments to the postprocessor -k, --keep-video Keep the video file on disk after the post-processing; the video is erased by default --no-post-overwrites Do not overwrite post-processed files; the post-processed files are overwritten by default --embed-subs Embed subtitles in the video (only for mkv and mp4 videos) --embed-thumbnail Embed thumbnail in the audio as cover art --add-metadata Write metadata to the video file --metadata-from-title FORMAT Parse additional metadata like song title / artist from the video title. The format syntax is the same as --output, the parsed parameters replace existing values. Additional templates: %(album)s, %(artist)s. Example: --metadata-from-title "%(artist)s - %(title)s" matches a title like "Coldplay - Paradise" --xattrs Write metadata to the video file's xattrs (using dublin core and xdg standards) --fixup POLICY Automatically correct known faults of the file. One of never (do nothing), warn (only emit a warning), detect_or_warn (the default; fix file if we can, warn otherwise) --prefer-avconv Prefer avconv over ffmpeg for running the postprocessors (default) --prefer-ffmpeg Prefer ffmpeg over avconv for running the postprocessors --ffmpeg-location PATH Location of the ffmpeg/avconv binary; either the path to the binary or its containing directory. --exec CMD Execute a command on the file after downloading, similar to find's -exec syntax. Example: --exec 'adb push {} /sdcard/Music/ && rm {}' --convert-subtitles FORMAT Convert the subtitles to other format (currently supported: srt|ass|vtt)

CONFIGURATION

You can configure youtube-dl by placing any supported command line option to a configuration file. On Linux, system wide configuration file is located at /etc/youtube-dl.conf and user wide configuration file at ~/.config/youtube-dl/config. On Windows, the user wide configuration file locations are %APPDATA%\youtube-dl\config.txt or C:\Users\<user name>\youtube-dl.conf. For example, with the following configration file youtube-dl will always extract the audio, not copy the mtime and use proxy:

--extract-audio --no-mtime --proxy 127.0.0.1:3128

You can use --ignore-config if you want to disable configuration file for a particular youtube-dl run.

Authentication with .netrc file

You may also want to configure automatic credentials storage for extractors that support authentication (by providing login and password with --username and --password) in order not to pass credentials as command line arguments on every youtube-dl execution and prevent tracking plain text passwords in shell command history. You can achieve this using .netrc file on per extractor basis. For that you will need to create .netrc file in your $HOME and restrict permissions to read/write by you only:

touch $HOME/.netrc chmod a-rwx,u+rw $HOME/.netrc

After that you can add credentials for extractor in the following format, where extractor is the name of extractor in lowercase:

machine <extractor> login <login> password <password>

For example:

machine youtube login myaccount@gmail.com password my_youtube_password machine twitch login my_twitch_account_name password my_twitch_password

To activate authentication with .netrc file you should pass --netrc to youtube-dl or place it in configuration file.

On Windows you may also need to setup %HOME% environment variable manually.

OUTPUT TEMPLATE

The -o option allows users to indicate a template for the output file names. The basic usage is not to set any template arguments when downloading a single file, like in youtube-dl -o funny_video.flv "http://some/video". However, it may contain special sequences that will be replaced when downloading each video. The special sequences have the format %(NAME)s. To clarify, that is a percent symbol followed by a name in parenthesis, followed by a lowercase S. Allowed names are:

• id: The sequence will be replaced by the video identifier.
• url: The sequence will be replaced by the video URL.
• uploader: The sequence will be replaced by the nickname of the person who uploaded the video.
• upload_date: The sequence will be replaced by the upload date in YYYYMMDD format.
• title: The sequence will be replaced by the video title.
• ext: The sequence will be replaced by the appropriate extension (like flv or mp4).
• epoch: The sequence will be replaced by the Unix epoch when creating the file.
• autonumber: The sequence will be replaced by a five-digit number that will be increased with each download, starting at zero.
• playlist: The sequence will be replaced by the name or the id of the playlist that contains the video.
• playlist_index: The sequence will be replaced by the index of the video in the playlist padded with leading zeros according to the total length of the playlist.
• format_id: The sequence will be replaced by the format code specified by --format.
• duration: The sequence will be replaced by the length of the video in seconds.

The current default template is %(title)s-%(id)s.%(ext)s.

In some cases, you don't want special characters such as 中, spaces, or &, such as when transferring the downloaded filename to a Windows system or the filename through an 8bit-unsafe channel. In these cases, add the --restrict-filenames flag to get a shorter title:

$ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc youtube-dl test video ''_ä↭𝕐.mp4 # All kinds of weird characters $ youtube-dl --get-filename -o "%(title)s.%(ext)s" BaW_jenozKc --restrict-filenames youtube-dl_test_video_.mp4 # A simple file name

FORMAT SELECTION

By default youtube-dl tries to download the best quality, but sometimes you may want to download other format. The simplest case is requesting a specific format, for example -f 22. You can get the list of available formats using --list-formats, you can also use a file extension (currently it supports aac, m4a, mp3, mp4, ogg, wav, webm) or the special names best, bestvideo, bestaudio and worst.

If you want to download multiple videos and they don't have the same formats available, you can specify the order of preference using slashes, as in -f 22/17/18. You can also filter the video results by putting a condition in brackets, as in -f "best[height=720]" (or -f "[filesize>10M]"). This works for filesize, height, width, tbr, abr, vbr, asr, and fps and the comparisons <, <=, >, >=, =, != and for ext, acodec, vcodec, container, and protocol and the comparisons =, != . Formats for which the value is not known are excluded unless you put a question mark (?) after the operator. You can combine format filters, so -f "[height <=? 720][tbr>500]" selects up to 720p videos (or videos where the height is not known) with a bitrate of at least 500 KBit/s. Use commas to download multiple formats, such as -f 136/137/mp4/bestvideo,140/m4a/bestaudio. You can merge the video and audio of two formats into a single file using -f <video-format>+<audio-format> (requires ffmpeg or avconv), for example -f bestvideo+bestaudio. Format selectors can also be grouped using parentheses, for example if you want to download the best mp4 and webm formats with a height lower than 480 you can use -f '(mp4,webm)[height<480]'.

Since the end of April 2015 and version 2015.04.26 youtube-dl uses -f bestvideo+bestaudio/best as default format selection (see #5447, #5456). If ffmpeg or avconv are installed this results in downloading bestvideo and bestaudio separately and muxing them together into a single file giving the best overall quality available. Otherwise it falls back to best and results in downloading best available quality served as a single file. best is also needed for videos that don't come from YouTube because they don't provide the audio and video in two different files. If you want to only download some dash formats (for example if you are not interested in getting videos with a resolution higher than 1080p), you can add -f bestvideo[height<=?1080]+bestaudio/best to your configuration file. Note that if you use youtube-dl to stream to stdout (and most likely to pipe it to your media player then), i.e. you explicitly specify output template as -o -, youtube-dl still uses -f best format selection in order to start content delivery immediately to your player and not to wait until bestvideo and bestaudio are downloaded and muxed.

If you want to preserve the old format selection behavior (prior to youtube-dl 2015.04.26), i.e. you want to download best available quality media served as a single file, you should explicitly specify your choice with -f best. You may want to add it to the configuration file in order not to type it every time you run youtube-dl.

VIDEO SELECTION

Videos can be filtered by their upload date using the options --date, --datebefore or --dateafter, they accept dates in two formats:

• Absolute dates: Dates in the format YYYYMMDD.
• Relative dates: Dates in the format (now|today)[+-][0-9](day|week|month|year)(s)?

Examples:

# Download only the videos uploaded in the last 6 months $ youtube-dl --dateafter now-6months # Download only the videos uploaded on January 1, 1970 $ youtube-dl --date 19700101 $ # will only download the videos uploaded in the 200x decade $ youtube-dl --dateafter 20000101 --datebefore 20091231

FAQ

How do I update youtube-dl?

If you've followed our manual installation instructions, you can simply run youtube-dl -U (or, on Linux, sudo youtube-dl -U).

If you have used pip, a simple sudo pip install -U youtube-dl is sufficient to update.

If you have installed youtube-dl using a package manager like apt-get or yum, use the standard system update mechanism to update. Note that distribution packages are often outdated. As a rule of thumb, youtube-dl releases at least once a month, and often weekly or even daily. Simply go to http://yt-dl.org/ to find out the current version. Unfortunately, there is nothing we youtube-dl developers can do if your distributions serves a really outdated version. You can (and should) complain to your distribution in their bugtracker or support forum.

As a last resort, you can also uninstall the version installed by your package manager and follow our manual installation instructions. For that, remove the distribution's package, with a line like

sudo apt-get remove -y youtube-dl

Afterwards, simply follow our manual installation instructions:

sudo wget https://yt-dl.org/latest/youtube-dl -O /usr/local/bin/youtube-dl sudo chmod a+x /usr/local/bin/youtube-dl hash -r

Again, from then on you'll be able to update with sudo youtube-dl -U.

I'm getting an error Unable to extract OpenGraph title on YouTube playlists

YouTube changed their playlist format in March 2014 and later on, so you'll need at least youtube-dl 2014.07.25 to download all YouTube videos.

If you have installed youtube-dl with a package manager, pip, setup.py or a tarball, please use that to update. Note that Ubuntu packages do not seem to get updated anymore. Since we are not affiliated with Ubuntu, there is little we can do. Feel free to report bugs to the Ubuntu packaging guys - all they have to do is update the package to a somewhat recent version. See above for a way to update.

Do I always have to pass -citw?

By default, youtube-dl intends to have the best options (incidentally, if you have a convincing case that these should be different, please file an issue where you explain that). Therefore, it is unnecessary and sometimes harmful to copy long option strings from webpages. In particular, the only option out of -citw that is regularly useful is -i.

Can you please put the -b option back?

Most people asking this question are not aware that youtube-dl now defaults to downloading the highest available quality as reported by YouTube, which will be 1080p or 720p in some cases, so you no longer need the -b option. For some specific videos, maybe YouTube does not report them to be available in a specific high quality format you're interested in. In that case, simply request it with the -f option and youtube-dl will try to download it.

I get HTTP error 402 when trying to download a video. What's this?

Apparently YouTube requires you to pass a CAPTCHA test if you download too much. We're considering to provide a way to let you solve the CAPTCHA, but at the moment, your best course of action is pointing a webbrowser to the youtube URL, solving the CAPTCHA, and restart youtube-dl.

I have downloaded a video but how can I play it?

Once the video is fully downloaded, use any video player, such as vlc or mplayer.

I extracted a video URL with -g, but it does not play on another machine / in my webbrowser.

It depends a lot on the service. In many cases, requests for the video (to download/play it) must come from the same IP address and with the same cookies. Use the --cookies option to write the required cookies into a file, and advise your downloader to read cookies from that file. Some sites also require a common user agent to be used, use --dump-user-agent to see the one in use by youtube-dl.

It may be beneficial to use IPv6; in some cases, the restrictions are only applied to IPv4. Some services (sometimes only for a subset of videos) do not restrict the video URL by IP address, cookie, or user-agent, but these are the exception rather than the rule.

Please bear in mind that some URL protocols are not supported by browsers out of the box, including RTMP. If you are using -g, your own downloader must support these as well.

If you want to play the video on a machine that is not running youtube-dl, you can relay the video content from the machine that runs youtube-dl. You can use -o - to let youtube-dl stream a video to stdout, or simply allow the player to download the files written by youtube-dl in turn.

ERROR: no fmt_url_map or conn information found in video info

YouTube has switched to a new video info format in July 2011 which is not supported by old versions of youtube-dl. See above for how to update youtube-dl.