Repository: iamtalhaasghar/yewtube Branch: master Commit: 547fe7f68770 Files: 102 Total size: 368.6 KB Directory structure: gitextract_ckd9x4df/ ├── .gitignore ├── CHANGELOG.md ├── CONTRIBUTING.md ├── Dockerfile ├── ISSUE_TEMPLATE.md ├── LICENSE ├── MANIFEST.in ├── README.md ├── RELEASING.md ├── _config.yml ├── doc/ │ ├── conf.py │ ├── index.rst │ ├── modules.rst │ ├── mps_youtube.c.rst │ ├── mps_youtube.cache.rst │ ├── mps_youtube.commands.album_search.rst │ ├── mps_youtube.commands.config.rst │ ├── mps_youtube.commands.download.rst │ ├── mps_youtube.commands.local_playlist.rst │ ├── mps_youtube.commands.misc.rst │ ├── mps_youtube.commands.play.rst │ ├── mps_youtube.commands.rst │ ├── mps_youtube.commands.search.rst │ ├── mps_youtube.commands.songlist.rst │ ├── mps_youtube.config.rst │ ├── mps_youtube.content.rst │ ├── mps_youtube.g.rst │ ├── mps_youtube.helptext.rst │ ├── mps_youtube.history.rst │ ├── mps_youtube.init.rst │ ├── mps_youtube.main.rst │ ├── mps_youtube.mpris.rst │ ├── mps_youtube.paths.rst │ ├── mps_youtube.player.rst │ ├── mps_youtube.playlist.rst │ ├── mps_youtube.playlists.rst │ ├── mps_youtube.rst │ ├── mps_youtube.screen.rst │ ├── mps_youtube.streams.rst │ ├── mps_youtube.terminalsize.rst │ └── mps_youtube.util.rst ├── docs/ │ ├── changelog.md │ ├── contributing.md │ ├── css/ │ │ └── mkdocstrings.css │ ├── gen_ref_nav.py │ ├── index.md │ └── license.md ├── mkdocs.yml ├── mps_youtube/ │ ├── __init__.py │ ├── c.py │ ├── cache.py │ ├── commands/ │ │ ├── __init__.py │ │ ├── album_search.py │ │ ├── config.py │ │ ├── download.py │ │ ├── generate_playlist.py │ │ ├── lastfm.py │ │ ├── local_playlist.py │ │ ├── misc.py │ │ ├── play.py │ │ ├── search.py │ │ ├── songlist.py │ │ └── spotify_playlist.py │ ├── config.py │ ├── content.py │ ├── contentquery.py │ ├── description_parser.py │ ├── g.py │ ├── helptext.py │ ├── history.py │ ├── init.py │ ├── listview/ │ │ ├── __init__.py │ │ ├── base.py │ │ ├── livestream.py │ │ ├── songtitle.py │ │ └── user.py │ ├── main.py │ ├── mpris.py │ ├── pafy.py │ ├── paths.py │ ├── player.py │ ├── players/ │ │ ├── GenericPlayer.py │ │ ├── __init__.py │ │ ├── mplayer.py │ │ ├── mpv.py │ │ └── vlc.py │ ├── playlist.py │ ├── playlists.py │ ├── screen.py │ ├── streams.py │ ├── terminalsize.py │ ├── test/ │ │ ├── test_main.py │ │ ├── test_mpris.py │ │ ├── test_players_mplayer.py │ │ └── test_util.py │ └── util.py ├── requirements.txt ├── setup.cfg ├── setup.py ├── wheel_recipe.sh ├── yewtube.desktop └── yt ================================================ FILE CONTENTS ================================================ ================================================ FILE: .gitignore ================================================ *.py[cod] otherstuff/ pafy vi.py MANIFEST .dev .vscode # Packages *.egg *.egg-info dist build eggs parts bin var tags .env env/ .idea/ venv/ test.py ================================================ FILE: CHANGELOG.md ================================================ # Changelog ## v2.9.2 (2023-01-26) ### Fix * Remove pyreadline dependency (#105) ([#107](https://github.com/iamtalhaasghar/yewtube/issues/107)) ([`19e4148`](https://github.com/iamtalhaasghar/yewtube/commit/19e4148242380b543a4825962716550114984f11)) ## v2.9.1 (2023-01-26) ### Fix * #50 - brought back download audio file ([`b46dab4`](https://github.com/iamtalhaasghar/yewtube/commit/b46dab47e61c68efa0e51836a8cc9141d15d9e87)) ## v2.9.0 (2022-10-20) ### Feature * **mplayer:** Set cache ([#93](https://github.com/iamtalhaasghar/yewtube/issues/93)) ([`16d3a18`](https://github.com/iamtalhaasghar/yewtube/commit/16d3a186fb9feb24530e1f07b211062c44a515a0)) ### Fix * #76 video pops up ([`eaeff58`](https://github.com/iamtalhaasghar/yewtube/commit/eaeff58f94e2fd89706e42fdab6b8e82ef770941)) ## v2.8.5 (2022-09-08) ### Fix * #75 program crashes while creating custom playlist and saving it without playing ([`2552eff`](https://github.com/iamtalhaasghar/yewtube/commit/2552eff602683fbd28bc6841768bf6cf585fc960)) * **main:** Handle error when setting locale ([#86](https://github.com/iamtalhaasghar/yewtube/issues/86)) ([`ecd117c`](https://github.com/iamtalhaasghar/yewtube/commit/ecd117ca1ef753509b78082d6f919c9bc2b1756b)) * Enable quit-watch-later in mpv #77 ([`079e440`](https://github.com/iamtalhaasghar/yewtube/commit/079e44088260c938dc3ae71cd55146fb51de653e)) ### Documentation * Added common issues file. ([#91](https://github.com/iamtalhaasghar/yewtube/issues/91)) ([`4b69e5e`](https://github.com/iamtalhaasghar/yewtube/commit/4b69e5ee96ed36efa9a68f6315322ed3d44d1e3d)) ## v2.8.4 (2022-05-05) ### Fix * #53 viewing playlists uploaded by a user is back ([`f201cb5`](https://github.com/iamtalhaasghar/yewtube/commit/f201cb5f4cd45b9341ced6b549fc35a57e85eb9f)) ## v2.8.3 (2022-04-25) ### Fix * #45 fetch all videos of a playlist ([`261f468`](https://github.com/iamtalhaasghar/yewtube/commit/261f4687668c6c05415102c66587a27518bbac10)) * Save full playlists by name and all its videos ([`d69a959`](https://github.com/iamtalhaasghar/yewtube/commit/d69a9594c5824d97201774e81444b75aea93e861)) * #67 vlc dummy Interface does not work with live channels ([`2d4637b`](https://github.com/iamtalhaasghar/yewtube/commit/2d4637b04b6f738ab832b3beacab1e490e99a518)) ## v2.8.2 (2022-03-17) ### Fix * #63 module album search crash ([`3f2fcfb`](https://github.com/iamtalhaasghar/yewtube/commit/3f2fcfb27bb60928282d1a4a68adff22980f5938)) ## v2.8.1 (2022-03-08) ### Fix * #54 play video using youtube short link ([`92d1c77`](https://github.com/iamtalhaasghar/yewtube/commit/92d1c776d4bcc47509becadc5ba9248477dc0dcc)) * Use mkdocs instead of sphinx docs ([`32a2e9c`](https://github.com/iamtalhaasghar/yewtube/commit/32a2e9cdddac3ebb458d7bdcd793ed83ccc2fdf0)) ## v2.8.0 (2022-02-28) ### Feature * **helptext:** Help changelog ([`0643941`](https://github.com/iamtalhaasghar/yewtube/commit/06439411d7a78fe6701f7313e9b3b0720248a197)) * **setup:** Extras dependencies for mpris ([`936e890`](https://github.com/iamtalhaasghar/yewtube/commit/936e8909b5212eda3a64e8b93be79d4353e6d646)) ### Fix * #37 use `set pages` command to config how many search result pages to show ([`2baec5f`](https://github.com/iamtalhaasghar/yewtube/commit/2baec5fd11c0edf88d3543dd81333c5ecf67c918)) * #44 dont run init when importing mps_youtube ([`a072c22`](https://github.com/iamtalhaasghar/yewtube/commit/a072c22e2781160bca79d0164e46e49f07ac28e1)) * **mpris:** Handle no data on time-pos ([`8bb29d3`](https://github.com/iamtalhaasghar/yewtube/commit/8bb29d33825ad826e51d9d8eada32a9b7bd10ffd)) * #39 key error 'data' ([`834ed5b`](https://github.com/iamtalhaasghar/yewtube/commit/834ed5b0af5f92e1233e8ba327327654f67f61a0)) * #38 improved help menu responsiveness ([`972b4ef`](https://github.com/iamtalhaasghar/yewtube/commit/972b4efdb5fe8f5d3295b1c3fe607d209e7d39b6)) * #35 remove api key instructions ([`4f1fee3`](https://github.com/iamtalhaasghar/yewtube/commit/4f1fee3b711b2383b2704fba39bdce772894cc75)) * #24 colorama support for windows ([`9cf2616`](https://github.com/iamtalhaasghar/yewtube/commit/9cf261615a52f6ac64b6fb28390db2a71a7ab470)) ## v2.7.0 (2022-02-19) ### Feature * Use yewtube over tor using torsocks 🔥 ([`1e9c4ce`](https://github.com/iamtalhaasghar/yewtube/commit/1e9c4ce5992528286f552c8b563daef4abf9566a)) ## v2.6.9 (2022-02-19) ### Fix * #28 show changelog with `help new` command ([`d52b65d`](https://github.com/iamtalhaasghar/yewtube/commit/d52b65d0c0cd8708020a2d6788102d82d8ebeee5)) ## v2.6.8 (2022-02-19) ### Fix * fixed #26 album search working now without youtube api ([`9c3ae03`](https://github.com/iamtalhaasghar/yewtube/commit/9c3ae03b8c0ae006f1b9a917e4330270fec2f929)) ## v2.6.7 (2022-02-19) ### Fix * Check for app updates ([`eabfb52`](https://github.com/iamtalhaasghar/yewtube/commit/eabfb5233c7b87c5f300ebc41250a3f52db07411)) * Don't crash if playlists / history file has invalid youtube id fixed #24 ([`323d5d8`](https://github.com/iamtalhaasghar/yewtube/commit/323d5d822cefc23889665d71cfffe9e40750433b)) ## v2.6.6 (2022-02-18) ### Fix * Playlists are working again fixed #18 ([`bfceee4`](https://github.com/iamtalhaasghar/yewtube/commit/bfceee493261d099c85bf2c4c9e79e5710e9799f)) * Buffersize warning ([`d185c3f`](https://github.com/iamtalhaasghar/yewtube/commit/d185c3fdf8d520bcb4595f5e458d6022a7b6d1aa)) * **g:** Mpv msglevel ([`062b125`](https://github.com/iamtalhaasghar/yewtube/commit/062b12503a8fa15dc720cf3ac91f001b74a5cf10)) ## v2.6.5 (2022-02-17) ### Fix * Default player priority is vlc > mpv > mplayer on first install fixed #16 ([`35409eb`](https://github.com/iamtalhaasghar/yewtube/commit/35409eb31cc67f03c50589e02cdff2ad08fe4911)) * **mplayer:** _get_mplayer_version ([`ab21c5d`](https://github.com/iamtalhaasghar/yewtube/commit/ab21c5d1bc872ed482bf482ad37949129c1e4f78)) * Bring back requirements.txt to life ([`ff6e59d`](https://github.com/iamtalhaasghar/yewtube/commit/ff6e59d75834c61d72ec6bbc92f5eb339cc82607)) * **util.uea_pad:** Handle AttributeError on t.split ([`1643266`](https://github.com/iamtalhaasghar/yewtube/commit/1643266f21ccf7a99481a1615b4a53c4fbabc878)) ## v2.6.4 (2022-02-16) ### Fix * Duplicate changelog and readme files ([`0265ef7`](https://github.com/iamtalhaasghar/yewtube/commit/0265ef7507b539791684bdcf40b30ddaafc525e8)) ## v2.6.3 (2022-02-16) ### Fix * Welcome from semantic release python ([`c237a68`](https://github.com/iamtalhaasghar/yewtube/commit/c237a6808869062036f5196775352c1504eafe06)) # yewtube was forked from mps-youtube ### Features * was made to work without YouTube API v3 * play music in vlc with no gui



Version 0.2.8 17 February 2018 Features: --------- - Lastfm scrobbling (@rien333) (#758) - `splaylist` and `suser` commands for Spotify (@ritiek) (#678) - Autoplay support (@nikhilweee) (#594) - `genpl` command (@nishanthkarthik) (#642) - `video_format` configuration setting (@Vrihub) (#656) - `live` command for live streams (@Razesdark) (#635) - Add time column (@akaWolf) (#582) - Add video ID column (@Razesdark) (#627) - Allow filtering search by duration (@jas32096) (#548) - Allow filtering search by date (@jas32096) (#553) - Add `history recent` to display history without duplicates (@srvanrell) (#510) - `--no-textart` to disable ascii art (for screenreaders) (@Gongreg) (#517) - `set_title` option to disable setting window title (@ardrabczyk) (#498) - Add `s` command for getting stream information (@ritiek) (#675) - Add option to disable mpris (@hrnr) (#728) - Generate playlist from video description (@Razesdark) (#649) Enhancements: ------------- - Store playlists as m3u files instead of binary (@kraetzin) (#682) - Show replies when displaying comments (@paulfertser) (#677) - Use https urls for album art (@vszakats) (#574) - When using "repeat" with mpv, keep player running (@ritiek) (#660) - Display artist/album in mpris using lastfm (@vn-ki) (#739) - Use channel.list API for user search (@Razesdark) (#628) - Maintain volume across songs with mpv (@Razesdark) (#720) - Prevent mpris from crashing the main process (@hrnr) (#728) Bug fixes: ---------- - Fix mpris seeking with recent mpv vesions (@mg6) (#687) - Fix removing video from multi-page playlist (@kraetzin) (#695) - Skip unavailable tracks (@ritiek) (#734) - Correctly display minutes/seconds (@Laxa) (#748) - Handle `null` time-pos from mpv (@pritambaral) (#519) - Fix da/dv command regex (@Vrihub) (#691) - Skip channels in video/playlist searches (@ritiek) (#664) - Fix divide by zero error (@ids1024) (#620) Use `git log v0.2.7.1..v0.2.8` to see all changes, including various minor fixes, documentation changes, etc. not included here. ------------------------------------------------------------------------------- Version 0.2.7.1 6 July 2016 Bug fixes: ---------- - Fix pickle error (@ids1024) (#503) - Install LICENSE, README.md, and CHANGELOG as package_data (@ids1024) - Update youtube-dl in py2exe build (@ids1024) ------------------------------------------------------------------------------- Version 0.2.7 27 June 2016 Features: --------- - Setting for default audio format (@nishanthkarthik) (#71 #466 #467) - Search history with `history` command (@kraetzin) (#344 #472) - Add syntax for repeating a track several times (@ghallak) (#437 #490) - Reverse command (@kraetzin) (#422 #473) - New `daurl ` command (@maricn) (#402) Enhancements: ------------- - Pass `--no-ytdl` to mpv (@ids1024) (#492) - Do not suppress mpv output in debug mode (@ids1024) - Print traceback in debug mode (@ids1024) - Speed up `checkupdate` by avoiding redirects (@ids1024) (#454) - Pass `--play-and-exit` if vlc is used as a player (@ids1024)` Bug fixes: ---------- - Fix error with python 3.3 (@ids1024) (#414) - Fix maxres bug (@ids1024) (#430) - Fix playlist cache bug in info command (@ids1024) (#468) - Fix usersearch argument error (@ids1024) (#469 #482) - Fix progress bar with new mpv versions (@ids1024) (#470 #485) - Fix syntax error with set command (@ids1024) (#419) - Fix syntax error with -w, -f, -a (@ids1024) (#420) - Fix clipboard support (@ids1024) (#461) - Fix mpv version checking on windows (@ids1024) (#397) - Add youtube_dl as dependency to Dockerfile (@PI-Victor) (#481) Internal api changes: --------------------- - The code is now split between several files (@ids1024) (#208) - Add initial content api, for now only used for comments (@ids1024) - Begin documenting internal apis using sphinx (@ids1024) ------------------------------------------------------------------------------- Version 0.2.6 1 January 2016 Features: - Add browserplay command to play video in browser (rjvani) (#355 #390) - Make url command support multiple url, and allow loading urls from file (paulnicolet) (#90 #391) - Make youtube id available to download command (ids1024) (#375) - Make pagination work properly for all lists of songs (local playlists, etc.) and make them all support the dump command (ids1024) (#201) - Show warning when adding duplicate track to playlist (BensonQiu) (#374 #383) Bug fixes: - Support playlists longer than 200 items (ids1024) (#192) - Make dapl download complete playlist (JKatzwinkel) (#294 #325) - Use pyperclip instead of xerox, fixing clipboard on linux (ids1024) (#311) - Fix error message on windows when video title has & (ids1024) (#321) - Run notifier command in background (hrnr) (#339) - Correctly handle -v option of play (TimoDritschler) (#352) - Make it possible to use a pager with --help (livingBEEF) (#349) - Allow mplayer for https streams if version is new enough (ids1024 Evidlo paddatrapper) (#315 #336 #317) - Use mpv.com instead of mpv.exe on windows (ids1024) Internal API changes: - Split code into several files (still a work in progress) (ids1024) (#208) - Use a python decorator to declare commands (ids1024) - Create a paginatesongs() function for handling the pagination and dump command uniformly as mentioned in features (#399) (ids1024) - Various others There have been various other small bug fixes and internal API changes. Use `git log v0.2.5..0.2.6` to see all of them. ------------------------------------------------------------------------------- Version 0.2.5 1 June 2015 - Support python 3 only (will not run with python 2) - Fix progress bar bug on Windows (#215, #223) - Fix bug in playlist search (#282) - Add user_order setting for separate order of user searches (lol768) (#277) - Add mix command (lol768) (#241, #283) - Add page count with total number of pages and current page (JKatzwinkel) - Fix UnicodeEncodeError on non-unicode terminals - Install .desktop in setup.py so it does not have to be installed manually required for Ubuntu sound menu support ------------------------------------------------------------------------------- Version 0.2.4 13 May 2015 - Fix issue with rate-limiting in "album" command (#217) - Implement support for MPRIS (hrnr and ids1024) (#191, #210) - Fix display issue with small terminal width (#215) - Use version 3 of the youtube api (JKatzwinkel, ids1024, and lol768) (#256) version 2 was disabled by youtube and no longer works ------------------------------------------------------------------------------- Version 0.2.3 17 February 2015 - Fix issue with opening old playlist file (#214) - Fix issue with "set" command - Metadata tagging of downloaded audio files requires ffmpeg or avconv early implementation, uses YouTube video title, needs more work ------------------------------------------------------------------------------- Version 0.2.2 14 February 2015 - Implement skip to previous track (ids1024) #175 #18 #14 Use > and < keys for next and prev track, q for quit (was ctrl-c) mpv / mplayer input.conf can be imported to use custom keymappings - Implement optional external download application (ids1024 and np1) #198 #132 enter "help dl-command" for more info - Show stream quality on status line (Brebiche38) #134 #163 - Implement support for creating Windows builds with py2exe (ids1024) #190 Use setup.py in py2exe branch - Fix progress bar for mpv 0.7 (ids1024) #155 #161 Resolves issues with playback looping - Fix mps-youtube does not run on FreeBSD (nivit) - Fix YouTube comments overshoot window size - Fix issue with audio remux when using `d` download command ------------------------------------------------------------------------------- Version 0.2.1 27 November 2014 [Bugfix] - Detect installed player on installation (#149) ------------------------------------------------------------------------------- Version 0.2.0 25 November 2014 - Auto detect terminal window size - Transcode audio to MP3 and other formats (requires ffmpeg or avconv) - Enabled da and dv commands for playlist search results - Added dapl and dvpl to download YouTube playlist audio/video by url/id to a separate subdirectory (mtahmed) #110 - Progress indicator now works with mpv (previously only mplayer) - Added option to show system notifications (Alex Nisnevich) #95 (can be used with libnotify - notify-send on linux) - Added overwrite true/false option for downloads (mtahmed) #93 (skips download if downloaded file already exists) - Added copy to clipboard feature #97 (requires python xerox module and xclip on linux or pywin32 on windows) - Remux audio downloads for better file compatibility (#135) [Bugfix] - Accept two-character length usernames (#99) [Bugfix] - Expand ~ character in download directory setting (punchagan) [Bugfix] - Don't truncate filename (YoussF) #122 [Bugfix] - Exit with correct status code ------------------------------------------------------------------------------- Version 0.01.46 May 18 2014 - Added c to view comments for a video (first 50 comments, no reply-comments) - Added feature to match album tracks using MusicBrainz (vixus0) To search albums, enter "album" optionally followed by album title - Custom formatted search result list using "set columns" command Optionally shows: rating, likes, dislikes, views, user, date, category and comments (number of) in search results - Added "set order " command for specifying search result ordering - Added "set console-width" for setting output width (default 80) - Added uploaded date in video info display (request #64) - Added likes / dislikes in video info display ------------------------------------------------------------------------------- Version 0.01.44 Mar 27 2014 - Added max_res config item for selecting video resolution (request 56) - Added window_size and window_pos for selecting size / position of player - Improved handling of playlist file read/write (issue 66) - Revert to lower quality on unavailable/corrupt streams (issue 65) - Enabled multiple invocation commands (comma separated) (request 61) Eg: mpsyt //the doors, 1, shuffle, 1-3-a, quit - Improved url caching - Added shuffle command (no arguments, shuffles displayed items) - Handle 'video not available in your country' during multiple downloads - Fix UnicodeDecodeError in mplayer progress parsing (issue 58) - Fix UnicodeEncodeError under Windows with Python 2.7 (issue 59) ------------------------------------------------------------------------------- Version 0.01.41 Mar 14 2014 - new configuration option, max_results - sets number of returned results (1 - 50) - pl now accepts YouTube playlist id's as well as url's - Fix error in download of .m4a files when mplayer is set as player. - Added option for downloading multiple items eg. da 1-4 or dv 3,5,6 ------------------------------------------------------------------------------- Version 0.01.40 Mar 11 2014 - Bugfix release, corrects UnicodeDecode error ------------------------------------------------------------------------------- Version 0.01.39 Mar 10 2014 Features: - Added time / progress bar indicator. Big thanks to Thomas LÉVEIL! (mplayer only) - Added command to retrieve YouTube user playlists; userpl {username} or upl {username} - Added command to retrieve related videos; r{number} - playurl now respects -f, -w, and -a flags (fullscreen, window or audio) - Implemented input history persistence (uses readline, linux only) - Implemented non-interactive mode for command line invocation with playurl - Implemented less interactive mode for command line invocation with dlurl Changes: - // or .. prefix to search for YouTube playlists (was plsearch / pls) Help / Documentation: - help will show relevant help topic page e.g., help dlurl - Documented configuration options ("set" commands) - Re-authored some help categories - Changed help to help , removed menu from help pages Bugfixes - mplayer / mpv window now displays content title instead of url - Fixed issue with Python3 terminal output on playback ctrl-c interrupt - Fixed issue with debug mode not logging to file - Changed year format in YT playlist result screen to last two digits. (Under some environments it was showing 4-digit years) ------------------------------------------------------------------------------- Version 0.01.38 Mar 5 2014 - Added i for YT playlist information display - Added stream url preloading for first item of opened YT playlists - Added last-updated date to YT playlist search result list - Fixed UnicodeError when run in non-UTF8 environments - Added more verbosity to --version command line option - Added --debug command line option (logs to /mpsyt.log) ------------------------------------------------------------------------------- Version 0.01.37 Mar 2 2014 - Excluded YouTube paid videos from search results - Added "pl " command to open YouTube playlist url - Added "plsearch " command to search for YouTube playlists - Added "dump" command to show entire YT playlist (useful for saving locally) - Added "undump" command to undo dump (re-paginates YT playlist items) - Added "u " command to list uploads by uploader of - Added "url " command for retrieving a specific YT video - Added "playurl " command for directly playing a YT video - Added "dlurl " command for directly downloading a YT video - Changed command to list user uploads, new syntax is "user " - Added mpsyt --version flag for printing version info - Added mpsyt --help flag for printing help text - Fixed indentation bug when scrolling through readline history ------------------------------------------------------------------------------- Version 0.01.36 Feb 27 2014 - Wait for preloading item if it is selected while preloading - Fix bug where -a audio override is sometimes ignored ------------------------------------------------------------------------------- Version 0.01.35 Feb 25 2014 - Faster opening of audio streams with mpv (--demuxer-lavf-o=fflags=+ignid argument added for m4a streams) - Faster opening of audio streams with mplayer (reject m4a streams, prefer ogg streams) (fallback to video stream and suppress video when no ogg available) ------------------------------------------------------------------------------- Version 0.01.34 Feb 22 2014 - Fix bug: fails when no playlist file exists ------------------------------------------------------------------------------- Version 0.01.33 Feb 22 2014 - Changed structure of playlist file. Now consumes KB's rather than MB's - Same playlist file shared between Python2.7+ and Python3+ (was separate) - Improved display alignment for Russian text - Preload of url fails silently on unobtainable items (previously crashed) - Added prompt to mux audio on m4v download (experimental) ------------------------------------------------------------------------------- Version 0.01.32 Feb 17 2014 - Improve display alignment with certain unicode characters - Fix crash when using 'set' command on Windows (thomasleveil) ------------------------------------------------------------------------------- Version 0.01.31 Feb 13 2014 - Migrate location of config directory to reflect new name (~/.config/mps-youtube) ================================================ FILE: CONTRIBUTING.md ================================================ # Contributing for yewtube Contributions are very much appreciated! * Pull requests should be based on and submitted to the "develop" branch. * Please raise an issue to discuss what you plan to implement or change before you start if it is going to involve a lot of work on your part. * Please keep pull requests specific, do not make many disparate changes or new features in one request. A separate pull request for each feature change is preferred. * Please ensure your changes work in Python 3.3+ and Windows. ## Code conventions * Maximum line length is 80 characters * Follow the line-spacing style that is already in place. * Ensure all functions and classes have a PEP257 compliant docstring and the code is PEP8 compliant. ## Documentation Install required extra docs package to setup mkdocs: `pip install -e ".[docs]"` To run built-in dev server: `mkdocs serve` To deploy documentation to github page: `mkdocs gh-deploy` ================================================ FILE: Dockerfile ================================================ FROM python:3-stretch LABEL maintainer="Justin Garrison " \ org.label-schema.schema-version="1.0" \ org.label-schema.name="mps-youtube" \ org.label-schema.description="Terminal based YouTube player and downloader " \ org.label-schema.url="https://github.com/mps-youtube/mps-youtube/wiki" \ org.label-schema.vcs-url="https://github.com/mps-youtube/mps-youtube" \ org.label-schema.docker.cmd="docker run -v /dev/snd:/dev/snd -it --rm --privileged --name mpsyt mpsyt" RUN DEBIAN_FRONTEND=noninteractive && \ apt-get update && \ apt-get install -y mplayer mpv && \ rm -rf /var/lib/apt/lists/* && \ apt-get clean && apt-get purge RUN pip install mps-youtube youtube-dl ENTRYPOINT ["mpsyt"] ================================================ FILE: ISSUE_TEMPLATE.md ================================================ ## Issue / Suggestion ## Your Environment ================================================ FILE: LICENSE ================================================ GNU GENERAL PUBLIC LICENSE Version 3, 29 June 2007 Copyright (C) 2007 Free Software Foundation, Inc. {http://fsf.org/} Everyone is permitted to copy and distribute verbatim copies of this license document, but changing it is not allowed. Preamble The GNU General Public License is a free, copyleft license for software and other kinds of works. The licenses for most software and other practical works are designed to take away your freedom to share and change the works. By contrast, the GNU General Public License is intended to guarantee your freedom to share and change all versions of a program--to make sure it remains free software for all its users. We, the Free Software Foundation, use the GNU General Public License for most of our software; it applies also to any other work released this way by its authors. You can apply it to your programs, too. When we speak of free software, we are referring to freedom, not price. Our General Public Licenses are designed to make sure that you have the freedom to distribute copies of free software (and charge for them if you wish), that you receive source code or can get it if you want it, that you can change the software or use pieces of it in new free programs, and that you know you can do these things. To protect your rights, we need to prevent others from denying you these rights or asking you to surrender the rights. Therefore, you have certain responsibilities if you distribute copies of the software, or if you modify it: responsibilities to respect the freedom of others. For example, if you distribute copies of such a program, whether gratis or for a fee, you must pass on to the recipients the same freedoms that you received. You must make sure that they, too, receive or can get the source code. And you must show them these terms so they know their rights. Developers that use the GNU GPL protect your rights with two steps: (1) assert copyright on the software, and (2) offer you this License giving you legal permission to copy, distribute and/or modify it. For the developers' and authors' protection, the GPL clearly explains that there is no warranty for this free software. For both users' and authors' sake, the GPL requires that modified versions be marked as changed, so that their problems will not be attributed erroneously to authors of previous versions. Some devices are designed to deny users access to install or run modified versions of the software inside them, although the manufacturer can do so. This is fundamentally incompatible with the aim of protecting users' freedom to change the software. The systematic pattern of such abuse occurs in the area of products for individuals to use, which is precisely where it is most unacceptable. Therefore, we have designed this version of the GPL to prohibit the practice for those products. If such problems arise substantially in other domains, we stand ready to extend this provision to those domains in future versions of the GPL, as needed to protect the freedom of users. Finally, every program is threatened constantly by software patents. States should not allow patents to restrict development and use of software on general-purpose computers, but in those that do, we wish to avoid the special danger that patents applied to a free program could make it effectively proprietary. To prevent this, the GPL assures that patents cannot be used to render the program non-free. The precise terms and conditions for copying, distribution and modification follow. TERMS AND CONDITIONS 0. Definitions. "This License" refers to version 3 of the GNU General Public License. "Copyright" also means copyright-like laws that apply to other kinds of works, such as semiconductor masks. "The Program" refers to any copyrightable work licensed under this License. Each licensee is addressed as "you". "Licensees" and "recipients" may be individuals or organizations. To "modify" a work means to copy from or adapt all or part of the work in a fashion requiring copyright permission, other than the making of an exact copy. The resulting work is called a "modified version" of the earlier work or a work "based on" the earlier work. A "covered work" means either the unmodified Program or a work based on the Program. To "propagate" a work means to do anything with it that, without permission, would make you directly or secondarily liable for infringement under applicable copyright law, except executing it on a computer or modifying a private copy. Propagation includes copying, distribution (with or without modification), making available to the public, and in some countries other activities as well. To "convey" a work means any kind of propagation that enables other parties to make or receive copies. Mere interaction with a user through a computer network, with no transfer of a copy, is not conveying. An interactive user interface displays "Appropriate Legal Notices" to the extent that it includes a convenient and prominently visible feature that (1) displays an appropriate copyright notice, and (2) tells the user that there is no warranty for the work (except to the extent that warranties are provided), that licensees may convey the work under this License, and how to view a copy of this License. If the interface presents a list of user commands or options, such as a menu, a prominent item in the list meets this criterion. 1. Source Code. The "source code" for a work means the preferred form of the work for making modifications to it. "Object code" means any non-source form of a work. A "Standard Interface" means an interface that either is an official standard defined by a recognized standards body, or, in the case of interfaces specified for a particular programming language, one that is widely used among developers working in that language. The "System Libraries" of an executable work include anything, other than the work as a whole, that (a) is included in the normal form of packaging a Major Component, but which is not part of that Major Component, and (b) serves only to enable use of the work with that Major Component, or to implement a Standard Interface for which an implementation is available to the public in source code form. A "Major Component", in this context, means a major essential component (kernel, window system, and so on) of the specific operating system (if any) on which the executable work runs, or a compiler used to produce the work, or an object code interpreter used to run it. The "Corresponding Source" for a work in object code form means all the source code needed to generate, install, and (for an executable work) run the object code and to modify the work, including scripts to control those activities. However, it does not include the work's System Libraries, or general-purpose tools or generally available free programs which are used unmodified in performing those activities but which are not part of the work. For example, Corresponding Source includes interface definition files associated with source files for the work, and the source code for shared libraries and dynamically linked subprograms that the work is specifically designed to require, such as by intimate data communication or control flow between those subprograms and other parts of the work. The Corresponding Source need not include anything that users can regenerate automatically from other parts of the Corresponding Source. The Corresponding Source for a work in source code form is that same work. 2. Basic Permissions. All rights granted under this License are granted for the term of copyright on the Program, and are irrevocable provided the stated conditions are met. This License explicitly affirms your unlimited permission to run the unmodified Program. The output from running a covered work is covered by this License only if the output, given its content, constitutes a covered work. This License acknowledges your rights of fair use or other equivalent, as provided by copyright law. You may make, run and propagate covered works that you do not convey, without conditions so long as your license otherwise remains in force. You may convey covered works to others for the sole purpose of having them make modifications exclusively for you, or provide you with facilities for running those works, provided that you comply with the terms of this License in conveying all material for which you do not control copyright. Those thus making or running the covered works for you must do so exclusively on your behalf, under your direction and control, on terms that prohibit them from making any copies of your copyrighted material outside their relationship with you. Conveying under any other circumstances is permitted solely under the conditions stated below. Sublicensing is not allowed; section 10 makes it unnecessary. 3. Protecting Users' Legal Rights From Anti-Circumvention Law. No covered work shall be deemed part of an effective technological measure under any applicable law fulfilling obligations under article 11 of the WIPO copyright treaty adopted on 20 December 1996, or similar laws prohibiting or restricting circumvention of such measures. When you convey a covered work, you waive any legal power to forbid circumvention of technological measures to the extent such circumvention is effected by exercising rights under this License with respect to the covered work, and you disclaim any intention to limit operation or modification of the work as a means of enforcing, against the work's users, your or third parties' legal rights to forbid circumvention of technological measures. 4. Conveying Verbatim Copies. You may convey verbatim copies of the Program's source code as you receive it, in any medium, provided that you conspicuously and appropriately publish on each copy an appropriate copyright notice; keep intact all notices stating that this License and any non-permissive terms added in accord with section 7 apply to the code; keep intact all notices of the absence of any warranty; and give all recipients a copy of this License along with the Program. You may charge any price or no price for each copy that you convey, and you may offer support or warranty protection for a fee. 5. Conveying Modified Source Versions. You may convey a work based on the Program, or the modifications to produce it from the Program, in the form of source code under the terms of section 4, provided that you also meet all of these conditions: a) The work must carry prominent notices stating that you modified it, and giving a relevant date. b) The work must carry prominent notices stating that it is released under this License and any conditions added under section 7. This requirement modifies the requirement in section 4 to "keep intact all notices". c) You must license the entire work, as a whole, under this License to anyone who comes into possession of a copy. This License will therefore apply, along with any applicable section 7 additional terms, to the whole of the work, and all its parts, regardless of how they are packaged. This License gives no permission to license the work in any other way, but it does not invalidate such permission if you have separately received it. d) If the work has interactive user interfaces, each must display Appropriate Legal Notices; however, if the Program has interactive interfaces that do not display Appropriate Legal Notices, your work need not make them do so. A compilation of a covered work with other separate and independent works, which are not by their nature extensions of the covered work, and which are not combined with it such as to form a larger program, in or on a volume of a storage or distribution medium, is called an "aggregate" if the compilation and its resulting copyright are not used to limit the access or legal rights of the compilation's users beyond what the individual works permit. Inclusion of a covered work in an aggregate does not cause this License to apply to the other parts of the aggregate. 6. Conveying Non-Source Forms. You may convey a covered work in object code form under the terms of sections 4 and 5, provided that you also convey the machine-readable Corresponding Source under the terms of this License, in one of these ways: a) Convey the object code in, or embodied in, a physical product (including a physical distribution medium), accompanied by the Corresponding Source fixed on a durable physical medium customarily used for software interchange. b) Convey the object code in, or embodied in, a physical product (including a physical distribution medium), accompanied by a written offer, valid for at least three years and valid for as long as you offer spare parts or customer support for that product model, to give anyone who possesses the object code either (1) a copy of the Corresponding Source for all the software in the product that is covered by this License, on a durable physical medium customarily used for software interchange, for a price no more than your reasonable cost of physically performing this conveying of source, or (2) access to copy the Corresponding Source from a network server at no charge. c) Convey individual copies of the object code with a copy of the written offer to provide the Corresponding Source. This alternative is allowed only occasionally and noncommercially, and only if you received the object code with such an offer, in accord with subsection 6b. d) Convey the object code by offering access from a designated place (gratis or for a charge), and offer equivalent access to the Corresponding Source in the same way through the same place at no further charge. You need not require recipients to copy the Corresponding Source along with the object code. If the place to copy the object code is a network server, the Corresponding Source may be on a different server (operated by you or a third party) that supports equivalent copying facilities, provided you maintain clear directions next to the object code saying where to find the Corresponding Source. Regardless of what server hosts the Corresponding Source, you remain obligated to ensure that it is available for as long as needed to satisfy these requirements. e) Convey the object code using peer-to-peer transmission, provided you inform other peers where the object code and Corresponding Source of the work are being offered to the general public at no charge under subsection 6d. A separable portion of the object code, whose source code is excluded from the Corresponding Source as a System Library, need not be included in conveying the object code work. A "User Product" is either (1) a "consumer product", which means any tangible personal property which is normally used for personal, family, or household purposes, or (2) anything designed or sold for incorporation into a dwelling. In determining whether a product is a consumer product, doubtful cases shall be resolved in favor of coverage. For a particular product received by a particular user, "normally used" refers to a typical or common use of that class of product, regardless of the status of the particular user or of the way in which the particular user actually uses, or expects or is expected to use, the product. A product is a consumer product regardless of whether the product has substantial commercial, industrial or non-consumer uses, unless such uses represent the only significant mode of use of the product. "Installation Information" for a User Product means any methods, procedures, authorization keys, or other information required to install and execute modified versions of a covered work in that User Product from a modified version of its Corresponding Source. The information must suffice to ensure that the continued functioning of the modified object code is in no case prevented or interfered with solely because modification has been made. If you convey an object code work under this section in, or with, or specifically for use in, a User Product, and the conveying occurs as part of a transaction in which the right of possession and use of the User Product is transferred to the recipient in perpetuity or for a fixed term (regardless of how the transaction is characterized), the Corresponding Source conveyed under this section must be accompanied by the Installation Information. But this requirement does not apply if neither you nor any third party retains the ability to install modified object code on the User Product (for example, the work has been installed in ROM). The requirement to provide Installation Information does not include a requirement to continue to provide support service, warranty, or updates for a work that has been modified or installed by the recipient, or for the User Product in which it has been modified or installed. Access to a network may be denied when the modification itself materially and adversely affects the operation of the network or violates the rules and protocols for communication across the network. Corresponding Source conveyed, and Installation Information provided, in accord with this section must be in a format that is publicly documented (and with an implementation available to the public in source code form), and must require no special password or key for unpacking, reading or copying. 7. Additional Terms. "Additional permissions" are terms that supplement the terms of this License by making exceptions from one or more of its conditions. Additional permissions that are applicable to the entire Program shall be treated as though they were included in this License, to the extent that they are valid under applicable law. If additional permissions apply only to part of the Program, that part may be used separately under those permissions, but the entire Program remains governed by this License without regard to the additional permissions. When you convey a copy of a covered work, you may at your option remove any additional permissions from that copy, or from any part of it. (Additional permissions may be written to require their own removal in certain cases when you modify the work.) You may place additional permissions on material, added by you to a covered work, for which you have or can give appropriate copyright permission. Notwithstanding any other provision of this License, for material you add to a covered work, you may (if authorized by the copyright holders of that material) supplement the terms of this License with terms: a) Disclaiming warranty or limiting liability differently from the terms of sections 15 and 16 of this License; or b) Requiring preservation of specified reasonable legal notices or author attributions in that material or in the Appropriate Legal Notices displayed by works containing it; or c) Prohibiting misrepresentation of the origin of that material, or requiring that modified versions of such material be marked in reasonable ways as different from the original version; or d) Limiting the use for publicity purposes of names of licensors or authors of the material; or e) Declining to grant rights under trademark law for use of some trade names, trademarks, or service marks; or f) Requiring indemnification of licensors and authors of that material by anyone who conveys the material (or modified versions of it) with contractual assumptions of liability to the recipient, for any liability that these contractual assumptions directly impose on those licensors and authors. All other non-permissive additional terms are considered "further restrictions" within the meaning of section 10. If the Program as you received it, or any part of it, contains a notice stating that it is governed by this License along with a term that is a further restriction, you may remove that term. If a license document contains a further restriction but permits relicensing or conveying under this License, you may add to a covered work material governed by the terms of that license document, provided that the further restriction does not survive such relicensing or conveying. If you add terms to a covered work in accord with this section, you must place, in the relevant source files, a statement of the additional terms that apply to those files, or a notice indicating where to find the applicable terms. Additional terms, permissive or non-permissive, may be stated in the form of a separately written license, or stated as exceptions; the above requirements apply either way. 8. Termination. You may not propagate or modify a covered work except as expressly provided under this License. Any attempt otherwise to propagate or modify it is void, and will automatically terminate your rights under this License (including any patent licenses granted under the third paragraph of section 11). However, if you cease all violation of this License, then your license from a particular copyright holder is reinstated (a) provisionally, unless and until the copyright holder explicitly and finally terminates your license, and (b) permanently, if the copyright holder fails to notify you of the violation by some reasonable means prior to 60 days after the cessation. Moreover, your license from a particular copyright holder is reinstated permanently if the copyright holder notifies you of the violation by some reasonable means, this is the first time you have received notice of violation of this License (for any work) from that copyright holder, and you cure the violation prior to 30 days after your receipt of the notice. Termination of your rights under this section does not terminate the licenses of parties who have received copies or rights from you under this License. If your rights have been terminated and not permanently reinstated, you do not qualify to receive new licenses for the same material under section 10. 9. Acceptance Not Required for Having Copies. You are not required to accept this License in order to receive or run a copy of the Program. Ancillary propagation of a covered work occurring solely as a consequence of using peer-to-peer transmission to receive a copy likewise does not require acceptance. However, nothing other than this License grants you permission to propagate or modify any covered work. These actions infringe copyright if you do not accept this License. Therefore, by modifying or propagating a covered work, you indicate your acceptance of this License to do so. 10. Automatic Licensing of Downstream Recipients. Each time you convey a covered work, the recipient automatically receives a license from the original licensors, to run, modify and propagate that work, subject to this License. You are not responsible for enforcing compliance by third parties with this License. An "entity transaction" is a transaction transferring control of an organization, or substantially all assets of one, or subdividing an organization, or merging organizations. If propagation of a covered work results from an entity transaction, each party to that transaction who receives a copy of the work also receives whatever licenses to the work the party's predecessor in interest had or could give under the previous paragraph, plus a right to possession of the Corresponding Source of the work from the predecessor in interest, if the predecessor has it or can get it with reasonable efforts. You may not impose any further restrictions on the exercise of the rights granted or affirmed under this License. For example, you may not impose a license fee, royalty, or other charge for exercise of rights granted under this License, and you may not initiate litigation (including a cross-claim or counterclaim in a lawsuit) alleging that any patent claim is infringed by making, using, selling, offering for sale, or importing the Program or any portion of it. 11. Patents. A "contributor" is a copyright holder who authorizes use under this License of the Program or a work on which the Program is based. The work thus licensed is called the contributor's "contributor version". A contributor's "essential patent claims" are all patent claims owned or controlled by the contributor, whether already acquired or hereafter acquired, that would be infringed by some manner, permitted by this License, of making, using, or selling its contributor version, but do not include claims that would be infringed only as a consequence of further modification of the contributor version. For purposes of this definition, "control" includes the right to grant patent sublicenses in a manner consistent with the requirements of this License. Each contributor grants you a non-exclusive, worldwide, royalty-free patent license under the contributor's essential patent claims, to make, use, sell, offer for sale, import and otherwise run, modify and propagate the contents of its contributor version. In the following three paragraphs, a "patent license" is any express agreement or commitment, however denominated, not to enforce a patent (such as an express permission to practice a patent or covenant not to sue for patent infringement). To "grant" such a patent license to a party means to make such an agreement or commitment not to enforce a patent against the party. If you convey a covered work, knowingly relying on a patent license, and the Corresponding Source of the work is not available for anyone to copy, free of charge and under the terms of this License, through a publicly available network server or other readily accessible means, then you must either (1) cause the Corresponding Source to be so available, or (2) arrange to deprive yourself of the benefit of the patent license for this particular work, or (3) arrange, in a manner consistent with the requirements of this License, to extend the patent license to downstream recipients. "Knowingly relying" means you have actual knowledge that, but for the patent license, your conveying the covered work in a country, or your recipient's use of the covered work in a country, would infringe one or more identifiable patents in that country that you have reason to believe are valid. If, pursuant to or in connection with a single transaction or arrangement, you convey, or propagate by procuring conveyance of, a covered work, and grant a patent license to some of the parties receiving the covered work authorizing them to use, propagate, modify or convey a specific copy of the covered work, then the patent license you grant is automatically extended to all recipients of the covered work and works based on it. A patent license is "discriminatory" if it does not include within the scope of its coverage, prohibits the exercise of, or is conditioned on the non-exercise of one or more of the rights that are specifically granted under this License. You may not convey a covered work if you are a party to an arrangement with a third party that is in the business of distributing software, under which you make payment to the third party based on the extent of your activity of conveying the work, and under which the third party grants, to any of the parties who would receive the covered work from you, a discriminatory patent license (a) in connection with copies of the covered work conveyed by you (or copies made from those copies), or (b) primarily for and in connection with specific products or compilations that contain the covered work, unless you entered into that arrangement, or that patent license was granted, prior to 28 March 2007. Nothing in this License shall be construed as excluding or limiting any implied license or other defenses to infringement that may otherwise be available to you under applicable patent law. 12. No Surrender of Others' Freedom. If conditions are imposed on you (whether by court order, agreement or otherwise) that contradict the conditions of this License, they do not excuse you from the conditions of this License. If you cannot convey a covered work so as to satisfy simultaneously your obligations under this License and any other pertinent obligations, then as a consequence you may not convey it at all. For example, if you agree to terms that obligate you to collect a royalty for further conveying from those to whom you convey the Program, the only way you could satisfy both those terms and this License would be to refrain entirely from conveying the Program. 13. Use with the GNU Affero General Public License. Notwithstanding any other provision of this License, you have permission to link or combine any covered work with a work licensed under version 3 of the GNU Affero General Public License into a single combined work, and to convey the resulting work. The terms of this License will continue to apply to the part which is the covered work, but the special requirements of the GNU Affero General Public License, section 13, concerning interaction through a network will apply to the combination as such. 14. Revised Versions of this License. The Free Software Foundation may publish revised and/or new versions of the GNU General Public License from time to time. Such new versions will be similar in spirit to the present version, but may differ in detail to address new problems or concerns. Each version is given a distinguishing version number. If the Program specifies that a certain numbered version of the GNU General Public License "or any later version" applies to it, you have the option of following the terms and conditions either of that numbered version or of any later version published by the Free Software Foundation. If the Program does not specify a version number of the GNU General Public License, you may choose any version ever published by the Free Software Foundation. If the Program specifies that a proxy can decide which future versions of the GNU General Public License can be used, that proxy's public statement of acceptance of a version permanently authorizes you to choose that version for the Program. Later license versions may give you additional or different permissions. However, no additional obligations are imposed on any author or copyright holder as a result of your choosing to follow a later version. 15. Disclaimer of Warranty. THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION. 16. Limitation of Liability. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. 17. Interpretation of Sections 15 and 16. If the disclaimer of warranty and limitation of liability provided above cannot be given local legal effect according to their terms, reviewing courts shall apply local law that most closely approximates an absolute waiver of all civil liability in connection with the Program, unless a warranty or assumption of liability accompanies a copy of the Program in return for a fee. END OF TERMS AND CONDITIONS How to Apply These Terms to Your New Programs If you develop a new program, and you want it to be of the greatest possible use to the public, the best way to achieve this is to make it free software which everyone can redistribute and change under these terms. To do so, attach the following notices to the program. It is safest to attach them to the start of each source file to most effectively state the exclusion of warranty; and each file should have at least the "copyright" line and a pointer to where the full notice is found. {one line to give the program's name and a brief idea of what it does.} Copyright (C) {year} {name of author} This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see {http://www.gnu.org/licenses/}. Also add information on how to contact you by electronic and paper mail. If the program does terminal interaction, make it output a short notice like this when it starts in an interactive mode: Copyright (C) This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'. This is free software, and you are welcome to redistribute it under certain conditions; type `show c' for details. The hypothetical commands `show w' and `show c' should show the appropriate parts of the General Public License. Of course, your program's commands might be different; for a GUI interface, you would use an "about box". You should also get your employer (if you work as a programmer) or school, if any, to sign a "copyright disclaimer" for the program, if necessary. For more information on this, and how to apply and follow the GNU GPL, see {http://www.gnu.org/licenses/}. The GNU General Public License does not permit incorporating your program into proprietary programs. If your program is a subroutine library, you may consider it more useful to permit linking proprietary applications with the library. If this is what you want to do, use the GNU Lesser General Public License instead of this License. But first, please read {http://www.gnu.org/philosophy/why-not-lgpl.html}. ================================================ FILE: MANIFEST.in ================================================ include mps-youtube.desktop include LICENSE include README.md include CHANGELOG.md ================================================ FILE: README.md ================================================ ![](https://img.shields.io/pypi/v/yewtube.svg) ![](https://img.shields.io/pypi/wheel/yewtube.svg) 
                      _         _          
                     | |       | |         
  _   _  _____      _| |_ _   _| |__   ___ 
 | | | |/ _ \ \ /\ / / __| | | | '_ \ / _ \
 | |_| |  __/\ V  V /| |_| |_| | |_) |  __/
  \__, |\___| \_/\_/  \__|\__,_|_.__/ \___|
   __/ |                                   
  |___/
Terminal based YouTube player and downloader. No Youtube API key required. Forked from mps-youtube Installation ----------- # Stable Version ### Using pip 1. Install using `pip install yewtube` 2. Run using, `yt`. Enjoy! ### Using pipx (Recommended) 1. Install **_pipx_** using `pip install pipx` 2. Install `yewtube` using `pipx install yewtube` 3. Now, type `yt` That's it. # Latest Version ### Using pip 1. Install using `pip install git+https://github.com/iamtalhaasghar/yewtube.git` 2. Run using, `yt`. Enjoy! ### Using pipx 1. Install **_pipx_** using `pip install pipx` 2. Install `yewtube` using `pipx install git+https://github.com/iamtalhaasghar/yewtube.git` 3. Now, type `yt` That's it. What's new in yewtube? ---------------------- - **No Youtube API Key required** - **Run audio in VLC with no GUI** See complete and up-to-date changelog [here](https://github.com/iamtalhaasghar/yewtube/blob/master/CHANGELOG.md). These features are still inherited from [mps-youtube](https://github.com/mps-youtube/mps-youtube). - Search and play audio/video from YouTube - Search tracks of albums by album title - Search and import YouTube playlists - Create and save local playlists - Download audio/video - Convert to mp3 & other formats (requires ffmpeg or avconv) - View video comments - Works with Python 3.x - Works with Windows, Linux and Mac OS X - Requires mplayer, mpv or VLC This project is based on [mps-youtube](https://github.com/mps-youtube/mps-youtube) and mps-youtube is based on [mps](https://web.archive.org/web/20180429034221/https://github.com/np1/mps), a terminal based program to search, stream and download music. This implementation uses YouTube as a source of content and can play and download video as well as audio. The [pafy](https://github.com/mps-youtube/pafy) library handles interfacing with YouTube. [mps-youtube wiki](https://github.com/mps-youtube/mps-youtube/wiki/Troubleshooting)
[yewtube wiki](https://github.com/iamtalhaasghar/yewtube/wiki/FAQ) Screenshots ----------- Search:
![](http://mps-youtube.github.io/mps-youtube/std-search.png) A standard search is performed by entering `/` followed by search terms. You can play all of the search results by giving `1-` as input Repeating song/songs can be done with `song_number[loop]`, for example: `1[3]` or `4-6[2]` Local Playlists:
![](http://mps-youtube.github.io/mps-youtube/local-playlist.png) Search result items can easily be stored in local playlists. YouTube Playlists:
![](http://mps-youtube.github.io/mps-youtube/playlist-search.png) YouTube playlists can be searched and played or saved as local playlists. A playlist search is performed by `//` followed by search term. Download:
![](http://mps-youtube.github.io/mps-youtube/download.png) Content can be downloaded in various formats and resolutions. Comments:
![](http://mps-youtube.github.io/mps-youtube/comments.png) A basic comments browser is available to view YouTube user comments. Music Album Matching:
![](http://mps-youtube.github.io/mps-youtube/album-1.png) ![](http://mps-youtube.github.io/mps-youtube/album-2.png) An album title can be specified and yewtube will attempt to find matches for each track of the album, based on title and duration. Type `help search` for more info. Customisation:
![](http://mps-youtube.github.io/mps-youtube/customisation2.png) Search results can be customised to display additional fields and ordered by various criteria. This configuration was set up using the following commands ``` set order views set columns user:14 date comments rating likes dislikes category:9 views ``` Type `help config` for help on configuration options Upgrading --------- ### If installed using pipx ` pipx upgrade yewtube ` ### If installed using pip `pip install --upgrade yewtube` Usage ----- yewtube is run on the command line using the command: `yt` Enter `h` from within the program for help. Using yewtube with mpris ------------------------ 1. Install PyGObject, GTK and their dependencies based on this guide https://pygobject.readthedocs.io/en/latest/getting_started.html 2. Install yewtube with mpris extra ```shell > # recommended > pipx install 'yewtube[mpris]' > # or > pip install 'yewtube[mpris]' ``` 3. check yewtube version ```shell > yt --version yewtube version : 2.8.2 yt_dlp version : 2022.02.04 Python version : 3.9.7 (default, Nov 7 2021, 15:17:57) [GCC 11.2.0] Processor : x86_64 Machine type : x86_64 Architecture : 64bit, ELF Platform : Linux-5.13.0-35-generic-x86_64-with-glibc2.34 sys.stdout.enc : utf-8 default enc : utf-8 Config dir : /home/user/.config/mps-youtube dbus : 1.2.18 glib : True env:TERM : tmux-256color env:SHELL : /usr/bin/zsh env:LANG : en_US.UTF-8 ``` If everything working correctly, dbug and glib would have similar result as above text 4. run `set mpris true` on yewtube 5. check with `playerctl` ```shell > playerctl -l mps-youtube.instance567867 ``` Check also the [common-issue](https://github.com/iamtalhaasghar/yewtube/wiki/Common-issues) if you are having problem with yewtube. How to Contribute ----------------- Contributions are welcomed! However, please check out the [contribution page](https://github.com/iamtalhaasghar/yewtube/blob/master/CONTRIBUTING.md) before making a contribution. ================================================ FILE: RELEASING.md ================================================ Release process for pafy and mps-youtube ======================================== Looking at the commits and Github releases for previous versions can provide an example. Version numbers --------------- ### pafy Bump the `__version__` in `__init__.py`. ### mps-youtube Bump the `version` in `VERSION`, `__version__` and `__notes__` in `__init__.py`, and `VERSION` in `setup.py`. Changelogs ---------- Update `CHANGELOG` with a summary of changes since the last release. `git shortlog` can be helpful to see what commits have occurred. ### mps-youtube Also update `New Features` in `helptext.py`. This help section has ended up falling out of date. If it isn't kept up to date, it should probably be removed. Github Release -------------- Create a release through the Github website, tagging the commit that should be released. The text from the `CHANGELOG` should be copied to the release. py2exe ------ For mps-youtube, a `.exe` file should be built with `python setup.py py2exe` under Windows. Make sure the correct pafy and youtube-dl versions are being used, since they will be embedded in the binary. Attach this file to the Github release. PyPI ---- Push the source, and a wheel build, to PyPI. Be careful that everything is correct at this point; PyPI does not allow replacing an uploaded file with a different one of the same name. GPG Signatures -------------- The `.tar.gz` signatures for `pafy` and `mps-youtube` also have GPG signatures attached to the release. Currently, they are signed with @ids1024's key, so only he can perform this step. Possible Simplifications to this Process ---------------------------------------- The New Features help text isn't really important, but it is genuinely nice to have if kept up to date. Perhaps the `CHANGELOG` file isn't really needed, if Github releases includes that information. ================================================ FILE: _config.yml ================================================ theme: jekyll-theme-hacker ================================================ FILE: doc/conf.py ================================================ #!/usr/bin/env python3 # -*- coding: utf-8 -*- # # mps_youtube documentation build configuration file, created by # sphinx-quickstart on Mon Apr 18 17:35:31 2016. # # This file is execfile()d with the current directory set to its # containing dir. # # Note that not all possible configuration values are present in this # autogenerated file. # # All configuration values have a default; values that are commented out # serve to show the default. import sys import os import sphinx_rtd_theme # If extensions (or modules to document with autodoc) are in another directory, # add these directories to sys.path here. If the directory is relative to the # documentation root, use os.path.abspath to make it absolute, like shown here. #sys.path.insert(0, os.path.abspath('.')) # -- General configuration ------------------------------------------------ # If your documentation needs a minimal Sphinx version, state it here. #needs_sphinx = '1.0' # Add any Sphinx extension module names here, as strings. They can be # extensions coming with Sphinx (named 'sphinx.ext.*') or your custom # ones. extensions = [ 'sphinx.ext.autodoc', 'sphinx.ext.todo', ] # Add any paths that contain templates here, relative to this directory. templates_path = ['_templates'] # The suffix(es) of source filenames. # You can specify multiple suffix as a list of string: # source_suffix = ['.rst', '.md'] source_suffix = '.rst' # The encoding of source files. #source_encoding = 'utf-8-sig' # The master toctree document. master_doc = 'index' # General information about the project. project = 'mps_youtube' copyright = '2016, mps-youtube developers' author = 'mps-youtube developers' # The version info for the project you're documenting, acts as replacement for # |version| and |release|, also used in various other places throughout the # built documents. # # The short X.Y version. version = '' # The full version, including alpha/beta/rc tags. release = '' # The language for content autogenerated by Sphinx. Refer to documentation # for a list of supported languages. # # This is also used if you do content translation via gettext catalogs. # Usually you set "language" from the command line for these cases. language = 'en' # There are two options for replacing |today|: either, you set today to some # non-false value, then it is used: #today = '' # Else, today_fmt is used as the format for a strftime call. #today_fmt = '%B %d, %Y' # List of patterns, relative to source directory, that match files and # directories to ignore when looking for source files. # This patterns also effect to html_static_path and html_extra_path exclude_patterns = ['_build', 'Thumbs.db', '.DS_Store'] # The reST default role (used for this markup: `text`) to use for all # documents. #default_role = None # If true, '()' will be appended to :func: etc. cross-reference text. #add_function_parentheses = True # If true, the current module name will be prepended to all description # unit titles (such as .. function::). #add_module_names = True # If true, sectionauthor and moduleauthor directives will be shown in the # output. They are ignored by default. #show_authors = False # The name of the Pygments (syntax highlighting) style to use. pygments_style = 'sphinx' # A list of ignored prefixes for module index sorting. #modindex_common_prefix = [] # If true, keep warnings as "system message" paragraphs in the built documents. #keep_warnings = False # If true, `todo` and `todoList` produce output, else they produce nothing. todo_include_todos = True # -- Options for HTML output ---------------------------------------------- # The theme to use for HTML and HTML Help pages. See the documentation for # a list of builtin themes. #html_theme = 'alabaster' html_theme = "sphinx_rtd_theme" # Theme options are theme-specific and customize the look and feel of a theme # further. For a list of options available for each theme, see the # documentation. #html_theme_options = {} # Add any paths that contain custom themes here, relative to this directory. #html_theme_path = [] html_theme_path = [sphinx_rtd_theme.get_html_theme_path()] # The name for this set of Sphinx documents. # " v documentation" by default. #html_title = 'mps_youtube v' # A shorter title for the navigation bar. Default is the same as html_title. #html_short_title = None # The name of an image file (relative to this directory) to place at the top # of the sidebar. #html_logo = None # The name of an image file (relative to this directory) to use as a favicon of # the docs. This file should be a Windows icon file (.ico) being 16x16 or 32x32 # pixels large. #html_favicon = None # Add any paths that contain custom static files (such as style sheets) here, # relative to this directory. They are copied after the builtin static files, # so a file named "default.css" will overwrite the builtin "default.css". html_static_path = ['_static'] # Add any extra paths that contain custom files (such as robots.txt or # .htaccess) here, relative to this directory. These files are copied # directly to the root of the documentation. #html_extra_path = [] # If not None, a 'Last updated on:' timestamp is inserted at every page # bottom, using the given strftime format. # The empty string is equivalent to '%b %d, %Y'. #html_last_updated_fmt = None # If true, SmartyPants will be used to convert quotes and dashes to # typographically correct entities. #html_use_smartypants = True # Custom sidebar templates, maps document names to template names. #html_sidebars = {} # Additional templates that should be rendered to pages, maps page names to # template names. #html_additional_pages = {} # If false, no module index is generated. #html_domain_indices = True # If false, no index is generated. #html_use_index = True # If true, the index is split into individual pages for each letter. #html_split_index = False # If true, links to the reST sources are added to the pages. #html_show_sourcelink = True # If true, "Created using Sphinx" is shown in the HTML footer. Default is True. #html_show_sphinx = True # If true, "(C) Copyright ..." is shown in the HTML footer. Default is True. #html_show_copyright = True # If true, an OpenSearch description file will be output, and all pages will # contain a tag referring to it. The value of this option must be the # base URL from which the finished HTML is served. #html_use_opensearch = '' # This is the file name suffix for HTML files (e.g. ".xhtml"). #html_file_suffix = None # Language to be used for generating the HTML full-text search index. # Sphinx supports the following languages: # 'da', 'de', 'en', 'es', 'fi', 'fr', 'h', 'it', 'ja' # 'nl', 'no', 'pt', 'ro', 'r', 'sv', 'tr', 'zh' #html_search_language = 'en' # A dictionary with options for the search language support, empty by default. # 'ja' uses this config value. # 'zh' user can custom change `jieba` dictionary path. #html_search_options = {'type': 'default'} # The name of a javascript file (relative to the configuration directory) that # implements a search results scorer. If empty, the default will be used. #html_search_scorer = 'scorer.js' # Output file base name for HTML help builder. htmlhelp_basename = 'mps_youtubedoc' # -- Options for LaTeX output --------------------------------------------- latex_elements = { # The paper size ('letterpaper' or 'a4paper'). #'papersize': 'letterpaper', # The font size ('10pt', '11pt' or '12pt'). #'pointsize': '10pt', # Additional stuff for the LaTeX preamble. #'preamble': '', # Latex figure (float) alignment #'figure_align': 'htbp', } # Grouping the document tree into LaTeX files. List of tuples # (source start file, target name, title, # author, documentclass [howto, manual, or own class]). latex_documents = [ (master_doc, 'mps_youtube.tex', 'mps\\_youtube Documentation', 'Author', 'manual'), ] # The name of an image file (relative to this directory) to place at the top of # the title page. #latex_logo = None # For "manual" documents, if this is true, then toplevel headings are parts, # not chapters. #latex_use_parts = False # If true, show page references after internal links. #latex_show_pagerefs = False # If true, show URL addresses after external links. #latex_show_urls = False # Documents to append as an appendix to all manuals. #latex_appendices = [] # If false, no module index is generated. #latex_domain_indices = True # -- Options for manual page output --------------------------------------- # One entry per manual page. List of tuples # (source start file, name, description, authors, manual section). man_pages = [ (master_doc, 'mps_youtube', 'mps_youtube Documentation', [author], 1) ] # If true, show URL addresses after external links. #man_show_urls = False # -- Options for Texinfo output ------------------------------------------- # Grouping the document tree into Texinfo files. List of tuples # (source start file, target name, title, author, # dir menu entry, description, category) texinfo_documents = [ (master_doc, 'mps_youtube', 'mps_youtube Documentation', author, 'mps_youtube', 'One line description of project.', 'Miscellaneous'), ] # Documents to append as an appendix to all manuals. #texinfo_appendices = [] # If false, no module index is generated. #texinfo_domain_indices = True # How to display URL addresses: 'footnote', 'no', or 'inline'. #texinfo_show_urls = 'footnote' # If true, do not generate a @detailmenu in the "Top" node's menu. #texinfo_no_detailmenu = False # -- Options for Epub output ---------------------------------------------- # Bibliographic Dublin Core info. epub_title = project epub_author = author epub_publisher = author epub_copyright = copyright # The basename for the epub file. It defaults to the project name. #epub_basename = project # The HTML theme for the epub output. Since the default themes are not # optimized for small screen space, using the same theme for HTML and epub # output is usually not wise. This defaults to 'epub', a theme designed to save # visual space. #epub_theme = 'epub' # The language of the text. It defaults to the language option # or 'en' if the language is not set. #epub_language = '' # The scheme of the identifier. Typical schemes are ISBN or URL. #epub_scheme = '' # The unique identifier of the text. This can be a ISBN number # or the project homepage. #epub_identifier = '' # A unique identification for the text. #epub_uid = '' # A tuple containing the cover image and cover page html template filenames. #epub_cover = () # A sequence of (type, uri, title) tuples for the guide element of content.opf. #epub_guide = () # HTML files that should be inserted before the pages created by sphinx. # The format is a list of tuples containing the path and title. #epub_pre_files = [] # HTML files that should be inserted after the pages created by sphinx. # The format is a list of tuples containing the path and title. #epub_post_files = [] # A list of files that should not be packed into the epub file. epub_exclude_files = ['search.html'] # The depth of the table of contents in toc.ncx. #epub_tocdepth = 3 # Allow duplicate toc entries. #epub_tocdup = True # Choose between 'default' and 'includehidden'. #epub_tocscope = 'default' # Fix unsupported image types using the Pillow. #epub_fix_images = False # Scale large images. #epub_max_image_width = 0 # How to display URL addresses: 'footnote', 'no', or 'inline'. #epub_show_urls = 'inline' # If false, no index is generated. #epub_use_index = True ================================================ FILE: doc/index.rst ================================================ .. mps_youtube documentation master file, created by sphinx-quickstart on Mon Apr 18 17:35:31 2016. You can adapt this file completely to your liking, but it should at least contain the root `toctree` directive. API Documentation for mps_youtube ================================= Contents: .. toctree:: mps_youtube Indices and tables ================== * :ref:`genindex` * :ref:`modindex` * :ref:`search` ================================================ FILE: doc/modules.rst ================================================ mps_youtube =========== .. toctree:: :maxdepth: 4 mps_youtube ================================================ FILE: doc/mps_youtube.c.rst ================================================ mps_youtube.c module ==================== .. automodule:: mps_youtube.c :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.cache.rst ================================================ mps_youtube.cache module ======================== .. automodule:: mps_youtube.cache :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.album_search.rst ================================================ mps_youtube.commands.album_search module ======================================== .. automodule:: mps_youtube.commands.album_search :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.config.rst ================================================ mps_youtube.commands.config module ================================== .. automodule:: mps_youtube.commands.config :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.download.rst ================================================ mps_youtube.commands.download module ==================================== .. automodule:: mps_youtube.commands.download :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.local_playlist.rst ================================================ mps_youtube.commands.local_playlist module ========================================== .. automodule:: mps_youtube.commands.local_playlist :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.misc.rst ================================================ mps_youtube.commands.misc module ================================ .. automodule:: mps_youtube.commands.misc :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.play.rst ================================================ mps_youtube.commands.play module ================================ .. automodule:: mps_youtube.commands.play :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.rst ================================================ mps_youtube.commands package ============================ Submodules ---------- .. toctree:: mps_youtube.commands.album_search mps_youtube.commands.config mps_youtube.commands.download mps_youtube.commands.local_playlist mps_youtube.commands.misc mps_youtube.commands.play mps_youtube.commands.search mps_youtube.commands.songlist Module contents --------------- .. automodule:: mps_youtube.commands :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.search.rst ================================================ mps_youtube.commands.search module ================================== .. automodule:: mps_youtube.commands.search :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.commands.songlist.rst ================================================ mps_youtube.commands.songlist module ==================================== .. automodule:: mps_youtube.commands.songlist :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.config.rst ================================================ mps_youtube.config module ========================= .. automodule:: mps_youtube.config :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.content.rst ================================================ mps_youtube.content module ========================== .. automodule:: mps_youtube.content :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.g.rst ================================================ mps_youtube.g module ==================== .. automodule:: mps_youtube.g :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.helptext.rst ================================================ mps_youtube.helptext module =========================== .. automodule:: mps_youtube.helptext :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.history.rst ================================================ mps_youtube.history module ========================== .. automodule:: mps_youtube.history :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.init.rst ================================================ mps_youtube.init module ======================= .. automodule:: mps_youtube.init :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.main.rst ================================================ mps_youtube.main module ======================= .. automodule:: mps_youtube.main :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.mpris.rst ================================================ mps_youtube.mpris module ======================== .. automodule:: mps_youtube.mpris :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.paths.rst ================================================ mps_youtube.paths module ======================== .. automodule:: mps_youtube.paths :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.player.rst ================================================ mps_youtube.player module ========================= .. automodule:: mps_youtube.player :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.playlist.rst ================================================ mps_youtube.playlist module =========================== .. automodule:: mps_youtube.playlist :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.playlists.rst ================================================ mps_youtube.playlists module ============================ .. automodule:: mps_youtube.playlists :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.rst ================================================ mps_youtube package =================== Subpackages ----------- .. toctree:: mps_youtube.commands Submodules ---------- .. toctree:: mps_youtube.c mps_youtube.cache mps_youtube.config mps_youtube.content mps_youtube.g mps_youtube.helptext mps_youtube.history mps_youtube.init mps_youtube.main mps_youtube.mpris mps_youtube.paths mps_youtube.player mps_youtube.playlist mps_youtube.playlists mps_youtube.screen mps_youtube.streams mps_youtube.terminalsize mps_youtube.util Module contents --------------- .. automodule:: mps_youtube :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.screen.rst ================================================ mps_youtube.screen module ========================= .. automodule:: mps_youtube.screen :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.streams.rst ================================================ mps_youtube.streams module ========================== .. automodule:: mps_youtube.streams :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.terminalsize.rst ================================================ mps_youtube.terminalsize module =============================== .. automodule:: mps_youtube.terminalsize :members: :undoc-members: :show-inheritance: ================================================ FILE: doc/mps_youtube.util.rst ================================================ mps_youtube.util module ======================= .. automodule:: mps_youtube.util :members: :undoc-members: :show-inheritance: ================================================ FILE: docs/changelog.md ================================================ --8<-- "CHANGELOG.md" ================================================ FILE: docs/contributing.md ================================================ --8<-- "CONTRIBUTING.md" ================================================ FILE: docs/css/mkdocstrings.css ================================================ /* Indentation. */ div.doc-contents:not(.first) { padding-left: 25px; border-left: 4px solid rgba(230, 230, 230); margin-bottom: 80px; } /* Don't capitalize names. */ h5.doc-heading { text-transform: none !important; } /* Don't use vertical space on hidden ToC entries. */ .hidden-toc::before { margin-top: 0 !important; padding-top: 0 !important; } /* Don't show permalink of hidden ToC entries. */ .hidden-toc a.headerlink { display: none; } /* Avoid breaking parameters name, etc. in table cells. */ td code { word-break: normal !important; } /* For pieces of Markdown rendered in table cells. */ td p { margin-top: 0 !important; margin-bottom: 0 !important; } ================================================ FILE: docs/gen_ref_nav.py ================================================ #!/usr/bin/env python # -*- coding: utf-8 -*- """Generate the code reference pages and navigation.""" from pathlib import Path import mkdocs_gen_files nav = mkdocs_gen_files.Nav() skip_files = [ (Path("mps_youtube") / "config.py"), (Path("mps_youtube") / "mpris.py"), ] skip_files.extend((Path("mps_youtube") / "test").glob("*.py")) for path in sorted(Path("mps_youtube").glob("**/*.py")): if path in skip_files: continue module_path = path.with_suffix("") doc_path = path.relative_to("mps_youtube").with_suffix(".md") full_doc_path = Path("reference", doc_path) parts = list(module_path.parts) parts[-1] = f"{parts[-1]}.py" nav[parts] = doc_path with mkdocs_gen_files.open(full_doc_path, "w") as fd: ident = ".".join(module_path.parts) print("::: " + ident, file=fd) mkdocs_gen_files.set_edit_path(full_doc_path, path) with mkdocs_gen_files.open("reference/SUMMARY.md", "w") as nav_file: nav_file.writelines(nav.build_literate_nav()) ================================================ FILE: docs/index.md ================================================ --8<-- "README.md" ================================================ FILE: docs/license.md ================================================ ``` --8<-- "LICENSE" ``` ================================================ FILE: mkdocs.yml ================================================ site_name: Yewtube site_description: Terminal based YouTube player and downloader. site_url: https://iamtalhaasghar.github.io/yewtube repo_url: https://github.com/iamtalhaasghar/yewtube repo_name: iamtalhaasghar/yewtube nav: - Home: - Overview: index.md - Changelog: changelog.md - License: license.md - Code Reference: reference/ - Development: - Contributing: contributing.md theme: name: material features: - navigation.tabs palette: scheme: slate primary: teal accent: purple extra_css: - css/mkdocstrings.css markdown_extensions: - admonition - pymdownx.emoji - pymdownx.magiclink - pymdownx.snippets: check_paths: true - pymdownx.superfences - pymdownx.tabbed - pymdownx.tasklist - toc: permalink: true plugins: - search - mkdocstrings: watch: - mps_youtube - gen-files: scripts: - docs/gen_ref_nav.py - literate-nav: nav_file: SUMMARY.md ================================================ FILE: mps_youtube/__init__.py ================================================ from pip._vendor import pkg_resources __version__ = next((p.version for p in pkg_resources.working_set if p.project_name.lower() == 'yewtube'), "unable to determine") __author__ = "iamtalhaasghar" __license__ = "GPLv3" __url__ = "https://github.com/iamtalhaasghar/yewtube" ================================================ FILE: mps_youtube/c.py ================================================ """ Module for holding colour code values. """ import os import re import sys if sys.stdout.isatty(): white = "\x1b[%sm" % 0 ul = "\x1b[%sm" * 3 % (2, 4, 33) cols = ["\x1b[%sm" % n for n in range(91, 96)] red, green, yellow, blue, pink = cols else: ul = red = green = yellow = blue = pink = white = "" r, g, y, b, p, w = red, green, yellow, blue, pink, white ansirx = re.compile(r'\x1b\[\d*m', re.UNICODE) def c(colour, text): """ Return coloured text. """ colours = {'r': r, 'g': g, 'y': y, 'b':b, 'p':p} return colours[colour] + text + w def charcount(s): """ Return number of characters in string, with ANSI color codes excluded. """ return len(ansirx.sub('', s)) ================================================ FILE: mps_youtube/cache.py ================================================ import os import pickle from . import g, c, streams from .util import dbg # Updated every time incompatible changes are made to cache format, # So old cache can be dropped CACHE_VERSION = 1 def load(): """ Import cache file. """ if os.path.isfile(g.CACHEFILE): try: with open(g.CACHEFILE, "rb") as cf: cached = pickle.load(cf) # Note: will be none for yewtube 0.2.5 or earlier version = cached.get('version') if 'streams' in cached: if version and version >= 1: g.streams = cached['streams'] g.username_query_cache = cached['userdata'] else: g.streams = cached if 'pafy' in cached: pass #pafy.load_cache(cached['pafy']) dbg(c.g + "%s cached streams imported%s", str(len(g.streams)), c.w) except (EOFError, IOError): dbg(c.r + "Cache file failed to open" + c.w) streams.prune() def save(): """ Save stream cache. """ caches = dict( version=CACHE_VERSION, streams=g.streams, userdata=g.username_query_cache #,pafy=pafy.dump_cache() ) with open(g.CACHEFILE, "wb") as cf: pickle.dump(caches, cf, protocol=2) dbg(c.p + "saved cache file: " + g.CACHEFILE + c.w) ================================================ FILE: mps_youtube/commands/__init__.py ================================================ import collections import re from .. import g from ..main import completer Command = collections.namedtuple('Command', 'regex category usage function') # input types WORD = r'[^\W\d][-\w\s]{,100}' RS = r'(?:(?:repeat|shuffle|-[avfw])\s*)' PL = r'\S*?((?:RD|PL|LL|UU|FL|OL)[-_0-9a-zA-Z]+)\s*' ## @command decorator ## ## The @command decorator takes a single regex followed by one or more ## strings that corresponds to command names that will be added to ## the tab completion. ## ## If your command has short-forms, only register the longer ## forms. ## If you use several functions and regexes for the same command but different ## arguments, append the completion string on EACH function, not only ## the first time you register it. def command(regex, *commands): """ Decorator to register an mps-youtube command. """ for command in commands: completer.add_cmd(command) def decorator(function): cmd = Command(re.compile(regex), None, None, function) g.commands.append(cmd) return function return decorator # Placed at bottom to deal with cyclic imports from . import download, search, album_search, spotify_playlist, misc, config, local_playlist from . import play, songlist, generate_playlist, lastfm ================================================ FILE: mps_youtube/commands/album_search.py ================================================ import re import time import difflib from urllib.request import build_opener from urllib.error import HTTPError, URLError from urllib.parse import urlencode from xml.etree import ElementTree as ET from .. import c, g, screen, __version__, __url__, config, util, pafy from .. import content as content_py from . import command from .songlist import paginatesongs from .search import get_tracks_from_json def show_message(message, col=c.r, update=False): """ Show message using col, update screen if required. """ g.content = content_py.generate_songlist_display() g.message = col + message + c.w if update: screen.update() def _do_query(url, query, err='query failed', report=False): """ Perform http request using yewtube user agent header. if report is True, return whether response is from memo """ # create url opener ua = "mps-youtube/%s ( %s )" % (__version__, __url__) mpsyt_opener = build_opener() mpsyt_opener.addheaders = [('User-agent', ua)] # convert query to sorted list of tuples (needed for consistent url_memo) query = [(k, query[k]) for k in sorted(query.keys())] url = "%s?%s" % (url, urlencode(query)) try: wdata = mpsyt_opener.open(url).read().decode() except (URLError, HTTPError) as e: g.message = "%s: %s (%s)" % (err, e, url) g.content = content_py.logo(c.r) return None if not report else (None, False) return wdata if not report else (wdata, False) def _best_song_match(songs, title, duration, titleweight, durationweight): """ Select best matching song based on title, length. Score from 0 to 1 where 1 is best. titleweight and durationweight parameters added to enable function usage when duration can't be guessed """ # pylint: disable=R0914 seqmatch = difflib.SequenceMatcher def variance(a, b): """ Return difference ratio. """ return float(abs(a - b)) / max(a, b) candidates = [] ignore = "music video lyrics new lyrics video audio".split() extra = "official original vevo".split() for song in songs: dur, tit = int(song.length), song.title util.dbg("Title: %s, Duration: %s", tit, dur) for word in extra: if word in tit.lower() and word not in title.lower(): pattern = re.compile(word, re.I) tit = pattern.sub("", tit) for word in ignore: if word in tit.lower() and word not in title.lower(): pattern = re.compile(word, re.I) tit = pattern.sub("", tit) replacechars = re.compile(r"[\]\[\)\(\-]") tit = replacechars.sub(" ", tit) multiple_spaces = re.compile(r"(\s)(\s*)") tit = multiple_spaces.sub(r"\1", tit) title_score = seqmatch(None, title.lower(), tit.lower()).ratio() duration_score = 1 - variance(duration, dur) util.dbg("Title score: %s, Duration score: %s", title_score, duration_score) # apply weightings score = duration_score * durationweight + title_score * titleweight candidates.append((score, song)) best_score, best_song = max(candidates, key=lambda x: x[0]) percent_score = int(100 * best_score) return best_song, percent_score def _match_tracks(artist, title, mb_tracks): """ Match list of tracks in mb_tracks by performing multiple searches. """ # pylint: disable=R0914 util.dbg("artists is %s", artist) util.dbg("title is %s", title) title_artist_str = c.g + title + c.w, c.g + artist + c.w util.xprint("\nSearching for %s by %s\n\n" % title_artist_str) def dtime(x): """ Format time to M:S. """ return time.strftime('%M:%S', time.gmtime(int(x))) # do matching for track in mb_tracks: ttitle = track['title'] length = track['length'] util.xprint("Search : %s%s - %s%s - %s" % (c.y, artist, ttitle, c.w, dtime(length))) q = "%s %s" % (artist, ttitle) w = q = ttitle if artist == "Various Artists" else q query = w#generate_search_qs(w, 0) util.dbg(query) # perform fetch wdata = pafy.search_videos(q, int(config.PAGES.get)) # pafy.call_gdata('search', query) results = get_tracks_from_json(wdata) if not results: util.xprint(c.r + "Nothing matched :(\n" + c.w) continue s, score = _best_song_match( results, artist + " " + ttitle, length, .5, .5) cc = c.g if score > 85 else c.y cc = c.r if score < 75 else cc util.xprint("Matched: %s%s%s - %s \n[%sMatch confidence: " "%s%s]\n" % (c.y, s.title, c.w, util.fmt_time(s.length), cc, score, c.w)) yield s def _get_mb_tracks(albumid): """ Get track listing from MusicBraiz by album id. """ ns = {'mb': 'http://musicbrainz.org/ns/mmd-2.0#'} url = "http://musicbrainz.org/ws/2/release/" + albumid query = {"inc": "recordings"} wdata = _do_query(url, query, err='album search error') if not wdata: return None root = ET.fromstring(wdata) tlist = root.find("./mb:release/mb:medium-list/mb:medium/mb:track-list", namespaces=ns) mb_songs = tlist.findall("mb:track", namespaces=ns) tracks = [] path = "./mb:recording/mb:" for track in mb_songs: try: title, length, rawlength = "unknown", 0, 0 title = track.find(path + "title", namespaces=ns).text rawlength = track.find(path + "length", namespaces=ns).text length = int(round(float(rawlength) / 1000)) except (ValueError, AttributeError): util.xprint("not found") tracks.append(dict(title=title, length=length, rawlength=rawlength)) return tracks def _get_mb_album(albumname, **kwa): """ Return artist, album title and track count from MusicBrainz. """ url = "http://musicbrainz.org/ws/2/release/" qargs = dict( release='"%s"' % albumname, primarytype=kwa.get("primarytype", "album"), status=kwa.get("status", "official")) qargs.update({k: '"%s"' % v for k, v in kwa.items()}) qargs = ["%s:%s" % item for item in qargs.items()] qargs = {"query": " AND ".join(qargs)} g.message = "Album search for '%s%s%s'" % (c.y, albumname, c.w) wdata = _do_query(url, qargs) if not wdata: return None ns = {'mb': 'http://musicbrainz.org/ns/mmd-2.0#'} root = ET.fromstring(wdata) rlist = root.find("mb:release-list", namespaces=ns) if int(rlist.get('count')) == 0: return None album = rlist.find("mb:release", namespaces=ns) artist = album.find("./mb:artist-credit/mb:name-credit/mb:artist", namespaces=ns).find("mb:name", namespaces=ns).text title = album.find("mb:title", namespaces=ns).text aid = album.get('id') return dict(artist=artist, title=title, aid=aid) @command(r'album\s*(.{0,500})', 'album') def search_album(term): """Search for albums. """ # pylint: disable=R0914,R0912 if not term: show_message("Enter album name:", c.g, update=True) term = input("> ") if not term or len(term) < 2: g.message = c.r + "Not enough input!" + c.w g.content = content_py.generate_songlist_display() return album = _get_mb_album(term) if not album: show_message("Album '%s' not found!" % term) return prompt = "Artist? [%s] > " % album['artist'] util.xprint(prompt, end="") artistentry = input().strip() if artistentry: if artistentry == "q": show_message("Album search abandoned!") return album = _get_mb_album(term, artist=artistentry) if not album: show_message("Album '%s' by '%s' not found!" % (term, artistentry)) return title, artist = album['title'], album['artist'] mb_tracks = _get_mb_tracks(album['aid']) if not mb_tracks: show_message("Album '%s' by '%s' has 0 tracks!" % (title, artist)) return msg = "%s%s%s by %s%s%s\n\n" % (c.g, title, c.w, c.g, artist, c.w) msg += "Enter to begin matching or [q] to abort" g.message = msg g.content = "Tracks:\n" for n, track in enumerate(mb_tracks, 1): g.content += "%02s %s" % (n, track['title']) g.content += "\n" screen.update() entry = input("Continue? [Enter] > ") if entry == "": pass else: show_message("Album search abandoned!") return songs = [] screen.clear() itt = _match_tracks(artist, title, mb_tracks) stash = config.SEARCH_MUSIC.get, config.ORDER.get config.SEARCH_MUSIC.value = True config.ORDER.value = "relevance" try: songs.extend(itt) except KeyboardInterrupt: util.xprint("%sHalted!%s" % (c.r, c.w)) finally: config.SEARCH_MUSIC.value, config.ORDER.value = stash if songs: util.xprint("\n%s / %s songs matched" % (len(songs), len(mb_tracks))) input("Press Enter to continue") if g.lastfm_network: g.artist = artist g.album = title g.scrobble = True # Fill up queue with all the track names g.scrobble_queue = [t['title'] for t in mb_tracks] msg = "Contents of album %s%s - %s%s %s(%d/%d)%s:" % ( c.y, artist, title, c.w, c.b, len(songs), len(mb_tracks), c.w) failmsg = "Found no album tracks for %s%s%s" % (c.y, title, c.w) paginatesongs(songs, msg=msg, failmsg=failmsg) ================================================ FILE: mps_youtube/commands/config.py ================================================ from .. import g, c, config, util from . import command @command(r'set|showconfig', 'set', 'showconfig') def showconfig(): """ Dump config data. """ width = util.getxy().width longest_key = 17 longest_val = 0 has_temps = False for setting in config: val = config[setting] longest_val = max(longest_val, len(str(val.display))) has_temps = has_temps or val.temp_value is not None width -= 27 s = " %s%-{0}s%s : %-{1}s".format(longest_key, longest_val+1) if has_temps: width -= longest_val + 5 out = " %s%-{}s %-{}s %s%s%s\n".format(longest_key, longest_val) % ( c.ul, "Key", "Value", "Temporary", " " * width, c.w) else: out = " %s%-{}s %s%s%s\n".format(longest_key) % (c.ul, "Key", "Value", " " * width, c.w) for setting in config: val = config[setting] # don't show player specific settings if unknown player if not util.is_known_player(config.PLAYER.get) and \ val.require_known_player: continue # don't show max_results if auto determined if g.detectable_size and setting == "MAX_RESULTS": continue if g.detectable_size and setting == "CONSOLE_WIDTH": continue out += s % (c.g, setting.lower(), c.w, val.display) if has_temps: out += "%s%s" % (c.w, val.display_temp) out += "\n" g.content = out g.message = "Enter %sset %s to change\n" % (c.g, c.w) g.message += "Enter %sset all default%s to reset all" % (c.g, c.w) @command(r'set\s+-t\s*([-\w]+)\s*(.*)') def setconfigtemp(key, val): setconfig(key, val, is_temp=True) @command(r'set\s+([-\w]+)\s*(.*)') def setconfig(key, val, is_temp=False): """ Set configuration variable. """ key = key.replace("-", "_") if key.upper() == "ALL" and val.upper() == "DEFAULT": for ci in config: config[ci].value = config[ci].default config.save() message = "Default configuration reinstated" elif not key.upper() in config: message = "Unknown config item: %s%s%s" % (c.r, key, c.w) elif val.upper() == "DEFAULT": att = config[key.upper()] att.value = att.default att.temp_value = None message = "%s%s%s set to %s%s%s (default)" dispval = att.display or "None" message = message % (c.y, key, c.w, c.y, dispval, c.w) config.save() else: # config.save() will be called by config.set() method message = config[key.upper()].set(val, is_temp=is_temp) showconfig() g.message = message @command(r'encoders?', 'encoder') def show_encs(): """ Display available encoding presets. """ out = "%sEncoding profiles:%s\n\n" % (c.ul, c.w) for x, e in enumerate(g.encoders): sel = " (%sselected%s)" % (c.y, c.w) if config.ENCODER.get == x else "" out += "%2d. %s%s\n" % (x, e['name'], sel) g.content = out message = "Enter %sset encoder %s to select an encoder" g.message = message % (c.g, c.w) ================================================ FILE: mps_youtube/commands/download.py ================================================ import os import re import sys import time import shlex import random import subprocess from urllib.request import urlopen from urllib.error import HTTPError from .. import g, c, screen, streams, content, config, util, pafy from . import command, PL from .search import yt_url, user_pls from .songlist import dump, plist @command(r'(dv|da|d|dl|download)\s*(\d{1,4})', 'da', 'dv', 'd', 'dl', 'download') def download(dltype, num): """ Download a track or playlist by menu item number. """ # This function needs refactoring! # pylint: disable=R0912 # pylint: disable=R0914 if g.browse_mode == "ytpl" and dltype in ("da", "dv"): plid = g.ytpls[int(num) - 1]["link"] down_plist(dltype, plid) return elif g.browse_mode == "ytpl": g.message = "Use da or dv to specify audio / video playlist download" g.message = c.y + g.message + c.w g.content = content.generate_songlist_display() return elif g.browse_mode != "normal": g.message = "Download must refer to a specific video item" g.message = c.y + g.message + c.w g.content = content.generate_songlist_display() return screen.writestatus("Fetching video info...") song = (g.model[int(num) - 1]) # best = dltype.startswith("dv") or dltype.startswith("da") # # if not best: # # try: # # user prompt for download stream # url, ext, url_au, ext_au = prompt_dl(song) # # except KeyboardInterrupt: # g.message = c.r + "Download aborted!" + c.w # g.content = content.generate_songlist_display() # return # # if not url or ext_au == "abort": # # abort on invalid stream selection # g.content = content.generate_songlist_display() # g.message = "%sNo download selected / invalid input%s" % (c.y, c.w) # return # # else: # # download user selected stream(s) # filename = _make_fname(song, ext) # args = (song, filename, url) # # if url_au and ext_au: # # downloading video and audio stream for muxing # audio = False # filename_au = _make_fname(song, ext_au) # args_au = (song, filename_au, url_au) # # else: # audio = ext in ("m4a", "ogg") # # kwargs = dict(audio=audio) # # elif best: # # set updownload without prompt # url_au = None # av = "audio" if dltype.startswith("da") else "video" # audio = av == "audio" # filename = _make_fname(song, None, av=av) # args = (song, filename) # kwargs = dict(url=None, audio=audio) try: # perform download(s) # dl_filenames = [args[1]] # f = _download(*args, **kwargs) success = pafy.download_video(song.ytid, config.DDIR.get, True if dltype.startswith("da") else False) if success: g.message = "Saved \'" + song.title + "\' to " + c.g + config.DDIR.get + c.w # if url_au: # dl_filenames += [args_au[1]] # _download(*args_au, allow_transcode=False, **kwargs) except KeyboardInterrupt: g.message = c.r + "Download halted!" + c.w # try: # for downloaded in dl_filenames: # os.remove(downloaded) # # except IOError: # pass # if url_au: # # multiplex # name, ext = os.path.splitext(args[1]) # tmpvideoname = name + '.' +str(random.randint(10000, 99999)) + ext # os.rename(args[1], tmpvideoname) # mux_cmd = [g.muxapp, "-i", tmpvideoname, "-i", args_au[1], "-c", # "copy", name + ".mp4"] # # try: # subprocess.call(mux_cmd) # g.message = "Saved to :" + c.g + mux_cmd[7] + c.w # os.remove(tmpvideoname) # os.remove(args_au[1]) # # except KeyboardInterrupt: # g.message = "Audio/Video multiplex aborted!" g.content = content.generate_songlist_display() @command(r'(da|dv)\s+((?:\d+\s\d+|-\d+|\d+-|\d+,)(?:[\d\s,-]*))', 'da', 'dv') def down_many(dltype, choice, subdir=None): """ Download multiple items. """ choice = util.parse_multi(choice) choice = list(set(choice)) downsongs = [g.model[int(x) - 1] for x in choice] temp = g.model[::] g.model.songs = downsongs[::] count = len(downsongs) av = "audio" if dltype.startswith("da") else "video" msg = "" def handle_error(message): """ Handle error in download. """ g.message = message g.content = disp screen.update() time.sleep(2) g.model.songs.pop(0) try: for song in downsongs: g.result_count = len(g.model) disp = content.generate_songlist_display() title = "Download Queue (%s):%s\n\n" % (av, c.w) disp = re.sub(r"(Num\s*?Title.*?\n)", title, disp) g.content = disp screen.update() try: filename = _make_fname(song, None, av=av, subdir=subdir) except IOError as e: handle_error("Error for %s: %s" % (song.title, str(e))) count -= 1 continue except KeyError: handle_error("No audio track for %s" % song.title) count -= 1 continue try: _download(song, filename, url=None, audio=av == "audio") except HTTPError: handle_error("HTTP Error for %s" % song.title) count -= 1 continue g.model.songs.pop(0) msg = "Downloaded %s items" % count g.message = "Saved to " + c.g + song.title + c.w except KeyboardInterrupt: msg = "Downloads interrupted!" finally: g.model.songs = temp[::] g.message = msg g.result_count = len(g.model) g.content = content.generate_songlist_display() @command(r'(da|dv)pl\s+%s' % PL, 'dapl', 'dvpl') def down_plist(dltype, parturl): """ Download YouTube playlist. """ plist(parturl) dump(False) title = g.pafy_pls[parturl][0].title # Remove double quotes for convenience subdir = util.sanitize_filename(title.replace('"', '')) down_many(dltype, "1-", subdir=subdir) msg = g.message plist(parturl) g.message = msg @command(r'(da|dv)upl\s+(.*)', 'daupl', 'dvupl') def down_user_pls(dltype, user): """ Download all user playlists. """ user_pls(user) for i in g.ytpls: down_plist(dltype, i.get('link')) return def _make_fname(song, ext=None, av=None, subdir=None): """" Create download directory, generate filename. """ # pylint: disable=E1103 # Instance of 'bool' has no 'extension' member (some types not inferable) ddir = os.path.join(config.DDIR.get, subdir) if subdir else config.DDIR.get if not os.path.exists(ddir): os.makedirs(ddir) if not ext: stream = streams.select(streams.get(song), audio=av == "audio", m4a_ok=True) ext = stream['ext'] # filename = song.title[:59] + "." + ext filename = song.title + "." + ext # Remove double quotes for convenience filename = filename.replace('"', '') filename = os.path.join(ddir, util.sanitize_filename(filename)) return filename def extract_metadata(name): """ Try to determine metadata from video title. """ seps = name.count(" - ") artist = title = None if seps == 1: pos = name.find(" - ") artist = name[:pos].strip() title = name[pos + 3:].strip() else: title = name.strip() return dict(artist=artist, title=title) def remux_audio(filename, title): """ Remux audio file. Insert limited metadata tags. """ util.dbg("starting remux") temp_file = filename + "." + str(random.randint(10000, 99999)) os.rename(filename, temp_file) meta = extract_metadata(title) metadata = ["title=%s" % meta["title"]] if meta["artist"]: metadata = ["title=%s" % meta["title"], "-metadata", "artist=%s" % meta["artist"]] cmd = [g.muxapp, "-y", "-i", temp_file, "-acodec", "copy", "-metadata"] cmd += metadata + ["-vn", filename] util.dbg(cmd) try: with open(os.devnull, "w") as devnull: subprocess.call(cmd, stdout=devnull, stderr=subprocess.STDOUT) except OSError: util.dbg("Failed to remux audio using %s", g.muxapp) os.rename(temp_file, filename) else: os.unlink(temp_file) util.dbg("remuxed audio file using %s" % g.muxapp) def transcode(filename, enc_data): """ Re encode a download. """ base = os.path.splitext(filename)[0] exe = g.muxapp if g.transcoder_path == "auto" else g.transcoder_path # ensure valid executable if not exe or not os.path.exists(exe) or not os.access(exe, os.X_OK): util.xprint("Encoding failed. Couldn't find a valid encoder :(\n") time.sleep(2) return filename command = shlex.split(enc_data['command']) newcom, outfn = command[::], "" for n, d in enumerate(command): if d == "ENCODER_PATH": newcom[n] = exe elif d == "IN": newcom[n] = filename elif d == "OUT": newcom[n] = outfn = base elif d == "OUT.EXT": newcom[n] = outfn = base + "." + enc_data['ext'] returncode = subprocess.call(newcom) if returncode == 0 and g.delete_orig: os.unlink(filename) return outfn def external_download(song, filename, url): """ Perform download using external application. """ cmd = config.DOWNLOAD_COMMAND.get ddir, basename = config.DDIR.get, os.path.basename(filename) cmd_list = shlex.split(cmd) def list_string_sub(orig, repl, lst): """ Replace substrings for items in a list. """ return [x if orig not in x else x.replace(orig, repl) for x in lst] cmd_list = list_string_sub("%F", filename, cmd_list) cmd_list = list_string_sub("%d", ddir, cmd_list) cmd_list = list_string_sub("%f", basename, cmd_list) cmd_list = list_string_sub("%u", url, cmd_list) cmd_list = list_string_sub("%i", song.ytid, cmd_list) util.dbg("Downloading using: %s", " ".join(cmd_list)) subprocess.call(cmd_list) def _download(song, filename, url=None, audio=False, allow_transcode=True): """ Download file, show status. Return filename or None in case of user specified download command. """ # pylint: disable=R0914 # too many local variables # Instance of 'bool' has no 'url' member (some types not inferable) if not url: stream = streams.select(streams.get(song), audio=audio, m4a_ok=True) url = stream['url'] # if an external download command is set, use it if config.DOWNLOAD_COMMAND.get: title = c.y + os.path.splitext(os.path.basename(filename))[0] + c.w util.xprint("Downloading %s using custom command" % title) external_download(song, filename, url) return None if not config.OVERWRITE.get: if os.path.exists(filename): util.xprint("File exists. Skipping %s%s%s ..\n" % (c.r, filename, c.w)) time.sleep(0.2) return filename util.xprint("Downloading to %s%s%s .." % (c.r, filename, c.w)) status_string = (' {0}{1:,}{2} Bytes [{0}{3:.2%}{2}] received. Rate: ' '[{0}{4:4.0f} kbps{2}]. ETA: [{0}{5:.0f} secs{2}]') resp = urlopen(url) total = int(resp.info()['Content-Length'].strip()) chunksize, bytesdone, t0 = 16384, 0, time.time() outfh = open(filename, 'wb') while True: chunk = resp.read(chunksize) outfh.write(chunk) elapsed = time.time() - t0 bytesdone += len(chunk) rate = 0 if elapsed != 0: rate = (bytesdone / 1024) / elapsed if rate: eta = (total - bytesdone) / (rate * 1024) else: eta = 0 stats = (c.y, bytesdone, c.w, bytesdone * 1.0 / total, rate, eta) if not chunk: outfh.close() break status = status_string.format(*stats) sys.stdout.write("\r" + status + ' ' * 4 + "\r") sys.stdout.flush() active_encoder = g.encoders[config.ENCODER.get] ext = filename.split(".")[-1] valid_ext = ext in active_encoder['valid'].split(",") if audio and g.muxapp: remux_audio(filename, song.title) if config.ENCODER.get != 0 and valid_ext and allow_transcode: filename = transcode(filename, active_encoder) return filename def menu_prompt(model, prompt=" > ", rows=None, header=None, theading=None, footer=None, force=0): """ Generate a list of choice, returns item from model. """ content = "" for x in header, theading, rows, footer: if isinstance(x, list): for line in x: content += line + "\n" elif isinstance(x, str): content += x + "\n" g.content = content screen.update() choice = input(prompt) if choice in model: return model[choice] elif force: return menu_prompt(model, prompt, rows, header, theading, footer, force) elif not choice.strip(): return False, False else: # unrecognised input return False, "abort" def prompt_dl(song): """ Prompt user do choose a stream to dl. Return (url, extension). """ # pylint: disable=R0914 dl_data, p = get_dl_data(song) dl_text = gen_dl_text(dl_data, song, p) model = [x['url'] for x in dl_data] ed = enumerate(dl_data) model = {str(n + 1): (x['url'], x['ext']) for n, x in ed} url, ext = menu_prompt(model, "Download number: ", *dl_text) url2 = ext2 = None mediatype = [i for i in dl_data if i['url'] == url][0]['mediatype'] if mediatype == "video" and g.muxapp and not config.DOWNLOAD_COMMAND.get: # offer mux if not using external downloader dl_data, p = get_dl_data(song, mediatype="audio") dl_text = gen_dl_text(dl_data, song, p) au_choices = "1" if len(dl_data) == 1 else "1-%s" % len(dl_data) footer = [util.F('-audio') % ext, util.F('select mux') % au_choices] dl_text = tuple(dl_text[0:3]) + (footer,) aext = ("ogg", "m4a") model = [x['url'] for x in dl_data if x['ext'] in aext] ed = enumerate(dl_data) model = {str(n + 1): (x['url'], x['ext']) for n, x in ed} prompt = "Audio stream: " url2, ext2 = menu_prompt(model, prompt, *dl_text) return url, ext, url2, ext2 def gen_dl_text(ddata, song, p): """ Generate text for dl screen. """ hdr = [] hdr.append(" %s%s%s" % (c.r, song.title, c.w)) author = p.author hdr.append(c.r + " Uploaded by " + author + c.w) hdr.append(" [" + util.fmt_time(song.length) + "]") hdr.append("") heading = tuple("Item Format Quality Media Size Notes".split()) fmt = " {0}%-6s %-8s %-13s %-7s %-5s %-16s{1}" heading = [fmt.format(c.w, c.w) % heading] heading.append("") content = [] for n, d in enumerate(ddata): row = (n + 1, d['ext'], d['quality'], d['mediatype'], d['size'], d['notes']) fmt = " {0}%-6s %-8s %-13s %-7s %5s Mb %-16s{1}" row = fmt.format(c.g, c.w) % row content.append(row) content.append("") footer = "Select [%s1-%s%s] to download or [%sEnter%s] to return" footer = [footer % (c.y, len(content) - 1, c.w, c.y, c.w)] return(content, hdr, heading, footer) def get_dl_data(song, mediatype="any"): """ Get filesize and metadata for all streams, return dict. """ def mbsize(x): """ Return size in MB. """ return str(int(x / (1024 ** 2))) p = util.get_pafy(song) dldata = [] text = " [Fetching stream info] >" streamlist = [x for x in p.allstreams] if mediatype == "audio": streamlist = [x for x in p.audiostreams] l = len(streamlist) for n, stream in enumerate(streamlist): sys.stdout.write(text + "-" * n + ">" + " " * (l - n - 1) + "<\r") sys.stdout.flush() try: size = mbsize(stream.get_filesize()) except TypeError: util.dbg(c.r + "---Error getting stream size" + c.w) size = 0 item = {'mediatype': stream.mediatype, 'size': size, 'ext': stream.extension, 'quality': stream.quality, 'notes': stream.notes, 'url': stream.url} dldata.append(item) screen.writestatus("") return dldata, p @command(r'dlurl\s(.*[-_a-zA-Z0-9]{11}.*)', 'dlurl') def dl_url(url): """ Open and prompt for download of youtube video url. """ g.browse_mode = "normal" yt_url(url) if len(g.model) == 1: download("download", "1") if g.command_line: sys.exit() @command(r'daurl\s(.*[-_a-zA-Z0-9]{11}.*)', 'daurl') def da_url(url): """ Open and prompt for download of youtube best audio from url. """ g.browse_mode = "normal" yt_url(url) if len(g.model) == 1: download("da", "1") if g.command_line: sys.exit() ================================================ FILE: mps_youtube/commands/generate_playlist.py ================================================ """ Playlist Generation """ from os import path from random import choice import string from .. import content, g, playlists, screen, util, listview from ..playlist import Playlist from . import command, search, album_search @command(r'mkp\s*(.{1,100})', 'mkp') def generate_playlist(sourcefile): """Generate a playlist from video titles in sourcefile""" # Hooks into this, check if the argument --description is present if "--description" in sourcefile or "-d" in sourcefile: description_generator(sourcefile) return expanded_sourcefile = path.expanduser(sourcefile) if not check_sourcefile(expanded_sourcefile): g.message = util.F('mkp empty') % expanded_sourcefile else: queries = read_sourcefile(expanded_sourcefile) g.message = util.F('mkp parsed') % (len(queries), sourcefile) if queries: create_playlist(queries) g.message = util.F('pl help') g.content = content.playlists_display() def read_sourcefile(filename): """Read each line as a query from filename""" with open(filename) as srcfl: queries = list() for item in srcfl.readlines(): clean_item = str(item).strip() if not clean_item: continue queries.append(clean_item) return queries def check_sourcefile(filename): """Check if filename exists and has a non-zero size""" return path.isfile(filename) and path.getsize(filename) > 0 def create_playlist(queries, title=''): """Add a new playlist Create playlist with a random name, get the first match for each title in queries and append it to the playlist """ plname = title.replace(" ", "-") or random_plname() if not g.userpl.get(plname): g.userpl[plname] = Playlist(plname) for query in queries: g.message = util.F('mkp finding') % query screen.update() qresult = find_best_match(query) if qresult: g.userpl[plname].songs.append(qresult) if g.userpl[plname]: playlists.save() def find_best_match(query): """Find the best(first)""" # This assumes that the first match is the best one qs = search.generate_search_qs(query) wdata = pafy.call_gdata('search', qs) results = search.get_tracks_from_json(wdata) if results: res, score = album_search._best_song_match( results, query, 0.1, 1.0, 0.0) return res def random_plname(): """Generates a random alphanumeric string of 6 characters""" n_chars = 6 return ''.join(choice(string.ascii_lowercase + string.digits) for _ in range(n_chars)) def description_generator(text): """ Fetches a videos description and parses it for - combinations """ if not isinstance(g.model, Playlist): g.message = util.F("mkp desc unknown") return # Use only the first result, for now num = text.replace("--description", "") num = num.replace("-d", "") num = util.number_string_to_list(num)[0] query = {} query['id'] = g.model[num].ytid query['part'] = 'snippet' query['maxResults'] = '1' data = pafy.call_gdata('videos', query)['items'][0]['snippet'] title = "mkp %s" % data['title'] data = util.fetch_songs(data['description'], data['title']) columns = [ {"name": "idx", "size": 3, "heading": "Num"}, {"name": "artist", "size": 30, "heading": "Artist"}, {"name": "title", "size": "remaining", "heading": "Title"}, ] def run_m(idx): """ Create playlist based on the results selected """ create_playlist(idx, title) if data: data = [listview.ListSongtitle(x) for x in data] g.content = listview.ListView(columns, data, run_m) g.message = util.F("mkp desc which data") else: g.message = util.F("mkp no valid") return ================================================ FILE: mps_youtube/commands/lastfm.py ================================================ import time import datetime try: import pylast has_pylast = True except ImportError: has_pylast = False from .. import g, util, config from . import command @command(r'lastfm_connect', 'lastfm_connect') def init_network(verbose=True): """ Initialize the global pylast network variable """ if not has_pylast : if verbose: pylast_url = 'https://github.com/pylast/pylast' g.message = '"pylast" module not found\n see %s' % (pylast_url) return # TODO: Add option to read lastfm config from file or env variable key = config.LASTFM_API_KEY.get secret = config.LASTFM_API_SECRET.get password = config.LASTFM_PASSWORD.get # already hashed username = config.LASTFM_USERNAME.get if not (key and secret and password and username): if verbose: util.xprint("Not all Last.fm credentials were set.") return try: g.lastfm_network = pylast.LastFMNetwork(api_key=key, api_secret=secret, username=username, password_hash=password) if verbose: g.message = "Last.fm authentication successful!" except (pylast.WSError, pylast.MalformedResponseError, pylast.NetworkError) as e: if verbose: g.message = "Last.fm connection error: %s" % (str(e)) def scrobble_track(artist, album, track): """ Scrobble a track to the user's Last.fm account """ if not g.lastfm_network: return unix_timestamp = int(time.mktime(datetime.datetime.now().timetuple())) try: g.lastfm_network.scrobble(artist=artist, title=track, album=album, timestamp=unix_timestamp) except (pylast.WSError, pylast.MalformedResponseError, pylast.NetworkError): return def set_now_playing(artist, track): """ Set the current track as "now playing" on the user's Last.fm account """ if not g.lastfm_network: return try: g.lastfm_network.update_now_playing(artist=artist, title=track) except (pylast.WSError, pylast.MalformedResponseError, pylast.NetworkError): return ================================================ FILE: mps_youtube/commands/local_playlist.py ================================================ import re from .. import g, c, playlists, content, util from ..playlist import Playlist, Video from . import command, WORD from .songlist import paginatesongs, songlist_rm_add from ..util import parse_video_length @command(r'rmp\s*(\d+|%s)' % WORD, 'rmp') def playlist_remove(name): """ Delete a saved playlist by name - or purge working playlist if *all.""" if name.isdigit() or g.userpl.get(name): if name.isdigit(): name = int(name) - 1 name = sorted(g.userpl)[name] playlists.delete(name) g.message = "Deleted playlist %s%s%s" % (c.y, name, c.w) g.content = content.playlists_display() #playlists.save() else: g.message = util.F('pl not found advise ls') % name g.content = content.playlists_display() @command(r'add\s*(-?\d[-,\d\s]{1,250})(%s)' % WORD, 'add') def playlist_add(nums, playlist): """ Add selected song nums to saved playlist. """ nums = util.parse_multi(nums) # Replacing spaces with hyphens before checking if playlist already exist. # See https://github.com/mps-youtube/mps-youtube/issues/1046. playlist = playlist.replace(" ", "-") if not g.userpl.get(playlist): g.userpl[playlist] = Playlist(playlist) for songnum in nums: g.userpl[playlist].songs.append(g.model[songnum - 1]) dur = g.userpl[playlist].duration f = (len(nums), playlist, len(g.userpl[playlist]), dur) g.message = util.F('added to saved pl') % f if nums: playlists.save() g.content = content.generate_songlist_display() @command(r'mv\s*(\d{1,3})\s*(%s)' % WORD, 'mv') def playlist_rename_idx(_id, name): """ Rename a playlist by ID. """ _id = int(_id) - 1 playlist_rename(sorted(g.userpl)[_id] + " " + name) @command(r'mv\s*(%s\s+%s)' % (WORD, WORD), 'mv') def playlist_rename(playlists_): """ Rename a playlist using mv command. """ # Deal with old playlist names that permitted spaces a, b = "", playlists_.split(" ") while a not in g.userpl: a = (a + " " + (b.pop(0))).strip() if not b and a not in g.userpl: g.message = util.F('no pl match for rename') g.content = g.content or content.playlists_display() return b = "-".join(b) g.userpl[b] = Playlist(b) g.userpl[b].songs = list(g.userpl[a].songs) playlist_remove(a) g.message = util.F('pl renamed') % (a, b) playlists.save() @command(r'(rm|add)\s(?:\*|all)', 'rm', 'add') def add_rm_all(action): """ Add all displayed songs to current playlist. remove all displayed songs from view. """ if action == "rm": g.model.songs.clear() msg = c.b + "Cleared all songs" + c.w g.content = content.generate_songlist_display(zeromsg=msg) elif action == "add": size = len(g.model) songlist_rm_add("add", "-" + str(size)) @command(r'save', 'save') def save_last(): """ Save command with no playlist name. """ if g.last_opened: open_save_view("save", g.last_opened) else: saveas = "" # save using artist name in postion 1 if g.model: if g.selected_pafy_pls_id: # if a playlist was selected saveas = g.pafy_pls[g.selected_pafy_pls_id][0].info['info']['title'] else: # user didn't selected a playlist saveas = g.model[0].title[:18].strip() saveas = re.sub(r"[^-\w]", "-", saveas, flags=re.UNICODE) # loop to find next available name post = 0 while g.userpl.get(saveas): post += 1 saveas = g.model[0].title[:18].strip() + "-" + str(post) # Playlists are not allowed to start with a digit # TODO: Possibly change this, but ban purely numerical names saveas = saveas.lstrip("0123456789") open_save_view("save", saveas) @command(r'(open|save|view)\s*(%s)' % WORD, 'open', 'save', 'view') def open_save_view(action, name): """ Open, save or view a playlist by name. Get closest name match. """ name = name.replace(" ", "-") if action == "open" or action == "view": saved = g.userpl.get(name) if not saved: name = util.get_near_name(name, g.userpl) saved = g.userpl.get(name) elif action == "open": g.active.songs = list(saved.songs) g.last_opened = name msg = util.F("pl loaded") % name paginatesongs(g.active, msg=msg) elif action == "view": g.last_opened = "" msg = util.F("pl viewed") % name paginatesongs(list(saved.songs), msg=msg) elif not saved and action in "view open".split(): g.message = util.F("pl not found") % name g.content = content.playlists_display() elif action == "save": if not g.model: g.message = "Nothing to save. " + util.F('advise search') g.content = content.generate_songlist_display() else: if g.selected_pafy_pls_id: # if a playlist was selected by user: g.userpl[name] = Playlist(name, [Video(i['id'], i['title'], parse_video_length(i['duration'])) for i in g.pafy_pls[g.selected_pafy_pls_id][0].videos]) else: # user created custom playlist and never opened it and now wants to save it g.userpl[name] = Playlist(name, list(g.model.songs)) g.message = util.F('pl saved') % name playlists.save() g.content = content.generate_songlist_display() @command(r'(open|view)\s*(\d{1,4})', 'open', 'view') def open_view_bynum(action, num): """ Open or view a saved playlist by number. """ srt = sorted(g.userpl) name = srt[int(num) - 1] open_save_view(action, name) @command(r'ls', 'ls') def ls(): """ List user saved playlists. """ if not g.userpl: g.message = util.F('no playlists') g.content = g.content or \ content.generate_songlist_display(zeromsg=g.message) else: g.content = content.playlists_display() g.message = util.F('pl help') @command(r'vp', 'vp') def vp(): """ View current working playlist. """ msg = util.F('current pl') txt = util.F('advise add') if g.model else util.F('advise search') failmsg = util.F('pl empty') + " " + txt paginatesongs(g.active, msg=msg, failmsg=failmsg) ================================================ FILE: mps_youtube/commands/misc.py ================================================ import re from datetime import datetime, timedelta import socket import traceback from urllib.request import urlopen from urllib.error import HTTPError, URLError from .. import player try: # pylint: disable=F0401 import pyperclip has_pyperclip = True except ImportError: has_pyperclip = False try: import readline has_readline = True except ImportError: has_readline = False from .. import g, c, __version__, content, screen, cache, pafy from .. import streams, history, config, util from ..helptext import get_help from ..content import generate_songlist_display, logo, qrcode_display from . import command from .songlist import paginatesongs @command(r'clearcache') def clearcache(): """ Clear cached items - for debugging use. """ g.pafs = {} g.streams = {} util.dbg("%scache cleared%s", c.p, c.w) g.message = "cache cleared" @command(r'(?:help|h)(?:\s+([-_a-zA-Z]+))?', 'help') def show_help(choice): """ Print help message. """ g.content = get_help(choice) @command(r'(?:q|quit|exit)', 'quit', 'exit') def quits(showlogo=True): """ Exit the program. """ if has_readline and config.INPUT_HISTORY.get: readline.write_history_file(g.READLINE_FILE) util.dbg("Saved history file") cache.save() screen.clear() msg = logo(c.r, version=__version__) if showlogo else "" msg += util.F("exitmsg", 2) if config.CHECKUPDATE.get and showlogo: try: url = "https://raw.githubusercontent.com/iamtalhaasghar/yewtube/master/setup.py" v = urlopen(url, timeout=1).read().decode() v = re.search(r'__version__\s*=\s*"\s*([\d\.]+)\s*"\s*', v, re.MULTILINE) if v: v = v.group(1) if v > __version__: msg += "\n\nA newer version is available (%s). Use `help new` command to check what's changed.\n" % v except (URLError, HTTPError, socket.timeout): util.dbg("check update timed out") screen.msgexit(msg) def _format_comment(n, qnt, author_name, published_date, content, reply=False): # poster = snippet.get('authorDisplayName') # shortdate = util.yt_datetime(snippet.get('publishedAt', ''))[1] # text = snippet.get('textDisplay', '') cid = ("%s%s/%s %s" % ('└── ' if reply else '', n, qnt, c.c("g", author_name))) return ("%-39s %s\n" % (cid, published_date)) + \ c.c("y", content.strip()) + '\n\n' def _fetch_commentreplies(parentid): # return pafy.call_gdata('comments', { # 'parentId': parentid, # 'part': 'snippet', # 'textFormat': 'plainText', # 'maxResults': 50}).get('items', []) return None def fetch_comments(item): """ Fetch comments for item using gdata. """ # pylint: disable=R0912 # pylint: disable=R0914 ytid, title = item.ytid, item.title util.dbg("Fetching comments for %s", c.c("y", ytid)) screen.writestatus("Fetching comments for %s" % c.c("y", title[:55])) # qs = {'textFormat': 'plainText', # 'videoId': ytid, # 'maxResults': 50, # 'part': 'snippet'} # jsdata = None try: all_comments = pafy.get_comments(ytid) except Exception: raise # coms = [x.get('snippet', {}) for x in jsdata.get('items', [])] # skip blanks # coms = [x for x in coms # if len(x.get('topLevelComment', {}).get('snippet', {}).get('textDisplay', '').strip())] if not len(all_comments): g.message = "No comments for %s" % item.title[:50] g.content = generate_songlist_display() return commentstext = '' for n, com in enumerate(all_comments, 1): # snippet = com.get('topLevelComment', {}).get('snippet', {}) commentstext += _format_comment(n, len(all_comments), com['author']['name'], com['published'], com['content']) # todo fetch comment replies # if com.get('replyCount') > 0: # replies = _fetch_commentreplies(com.get('topLevelComment').get('id')) # for n, com in enumerate(reversed(replies), 1): # commentstext += _format_comment(com.get('snippet', {}), # n, len(replies), True) g.current_page = 0 g.content = content.StringContent(commentstext) @command(r'c\s?(\d{1,4})', 'c') def comments(number): """ Receive use request to view comments. """ if g.browse_mode == "normal": item = g.model[int(number) - 1] fetch_comments(item) else: g.content = generate_songlist_display() g.message = "Comments only available for video items" @command(r'x\s*(\d+)', 'x') def clipcopy_video(num): """ Copy video/playlist url to clipboard. """ if g.browse_mode == "ytpl": p = g.ytpls[int(num) - 1] link = "https://youtube.com/playlist?list=%s" % p['link'] elif g.browse_mode == "normal": item = (g.model[int(num) - 1]) link = "https://youtube.com/watch?v=%s" % item.ytid else: g.message = "clipboard copy not valid in this mode" g.content = generate_songlist_display() return if has_pyperclip: try: pyperclip.copy(link) g.message = c.y + link + c.w + " copied" g.content = generate_songlist_display() except Exception as e: g.content = generate_songlist_display() g.message = link + "\nError - couldn't copy to clipboard.\n" + \ ''.join(traceback.format_exception_only(type(e), e)) else: g.message = "pyperclip module must be installed for clipboard support\n" g.message += "see https://pypi.python.org/pypi/pyperclip/" g.content = generate_songlist_display() @command(r'X\s*(\d+)', 'X') def clipcopy_stream(num): """ Copy content stream url to clipboard. """ if g.browse_mode == "normal": item = (g.model[int(num) - 1]) details = player.stream_details(item)[1] stream = details['url'] else: g.message = "clipboard copy not valid in this mode" g.content = generate_songlist_display() return if has_pyperclip: try: pyperclip.copy(stream) g.message = c.y + stream + c.w + " copied" g.content = generate_songlist_display() except Exception as e: g.content = generate_songlist_display() g.message = stream + "\nError - couldn't copy to clipboard.\n" + \ ''.join(traceback.format_exception_only(type(e), e)) else: g.message = "pyperclip module must be installed for clipboard support\n" g.message += "see https://pypi.python.org/pypi/pyperclip/" g.content = generate_songlist_display() @command(r'i\s*(\d{1,4})', 'i') def video_info(num): """ Get video information. """ if g.browse_mode == "ytpl": p = g.ytpls[int(num) - 1] # fetch the playlist item as it has more metadata if p['link'] in g.pafy_pls: ytpl = g.pafy_pls[p['link']][0] else: g.content = logo(col=c.g) g.message = "Fetching playlist info.." screen.update() util.dbg("%sFetching playlist using pafy%s", c.y, c.w) ytpl = pafy.get_playlist2(p['link']) g.pafy_pls[p['link']] = (ytpl, util.IterSlicer(ytpl)) ytpl_desc = ytpl.description g.content = generate_songlist_display() created = util.yt_datetime_local(p['created']) updated = util.yt_datetime_local(p['updated']) out = c.ul + "Playlist Info" + c.w + "\n\n" out += p['title'] out += "\n" + ytpl_desc out += ("\n\nAuthor : " + p['author']) out += "\nSize : " + str(p['size']) + " videos" out += "\nCreated : " + created[1] + " " + created[2] out += "\nUpdated : " + updated[1] + " " + updated[2] out += "\nID : " + str(p['link']) out += ("\n\n%s[%sPress enter to go back%s]%s" % (c.y, c.w, c.y, c.w)) g.content = out elif g.browse_mode == "normal": g.content = logo(c.b) screen.update() screen.writestatus("Fetching video metadata..") item = (g.model[int(num) - 1]) streams.get(item) p = pafy.get_video_info(item.ytid) #pub = datetime.strptime(str(p.published), "%Y-%m-%d %H:%M:%SZ") #pub = util.utc2local(pub) screen.writestatus("Fetched") out = c.ul + "Video Info" + c.w + "\n\n" out += p['title'] or "" out += "\n\nDescription:\n\n" + str(p.get('description', "")) + "\n" out += "\nKeywords: " + str(p['keywords']) + "\n" out += "\nIs Live Now : " + str(p['isLiveNow']) out += "\nDuration : " + str(timedelta(seconds=int(p['duration']['secondsText']))) out += "\nView count : " + "{:,}".format(int(p['viewCount']['text'])) out += "\nAuthor : " + str(p['channel']['name'] + ' ~ ' + p['channel']['link']) out += "\nPublished Date : " + str(p['publishDate']) out += "\nUploaded Date : " + str(p['uploadDate']) out += "\nRating : " + str(p['averageRating']) out += "\nLikes : " + "{:,}".format(p.get('likes', 0)) out += "\nDislikes : " + "{:,}".format(p.get('dislikes', 0)) out += "\nCategory : " + str(p['category']) out += "\nFamily Safe : " + str(p['isFamilySafe']) out += "\nLink : " + str(p['link']) if config.SHOW_QRCODE.get: out += "\n" + qrcode_display( "https://youtube.com/watch?v=%s" % p.videoid) out += "\n\n%s[%sPress enter to go back%s]%s" % (c.y, c.w, c.y, c.w) g.content = out @command(r's\s*(\d{1,4})', 's') def stream_info(num): """ Get stream information. """ if g.browse_mode == "normal": g.content = logo(c.b) screen.update() screen.writestatus("Fetching stream metadata..") item = (g.model[int(num) - 1]) streams.get(item) p = util.get_pafy(item) setattr(p, 'ytid', p.videoid) details = player.stream_details(p)[1] screen.writestatus("Fetched") out = "\n\n" + c.ul + "Stream Info" + c.w + "\n" out += "\nExtension : " + details['ext'] out += "\nSize : " + str(details['size']) out += "\nQuality : " + details['quality'] out += "\nRaw bitrate : " + str(details['rawbitrate']) out += "\nMedia type : " + details['mtype'] out += "\nLink : " + details['url'] out += "\n\n%s[%sPress enter to go back%s]%s" % (c.y, c.w, c.y, c.w) g.content = out @command(r'history', 'history') def view_history(duplicates=True): """ Display the user's play history """ history = g.userhist.get('history') #g.last_opened = "" try: hist_list = list(reversed(history.songs)) message = "Viewing play history" if not duplicates: # List unique elements and preserve order. seen = set() seen_add = seen.add # it makes calls to add() faster hist_list = [x for x in hist_list if not (x.ytid in seen or seen_add(x.ytid))] message = "Viewing recent played songs" paginatesongs(hist_list) g.message = message except AttributeError: g.content = logo(c.r) g.message = "History empty" if not config.HISTORY.get: g.message += "\t{1}History recording is currently off{0}".format(c.w,c.y) @command(r'history recent', 'history recent') def recent_history(): """ Display the recent user's played songs """ view_history(duplicates=False) @command(r'history clear', 'history clear') def clear_history(): """ Clears the user's play history """ g.userhist['history'].songs = [] history.save() g.message = "History cleared" g.content = logo() ================================================ FILE: mps_youtube/commands/play.py ================================================ import random import sys import typing as T import webbrowser from urllib.error import HTTPError, URLError from .. import c, config, content, g, streams, util from . import RS, WORD, command from .search import related, yt_url from .songlist import plist @command(r'play all', 'play all') def play_loaded(): g.model.songs = content.get_last_query() if g.model.songs: play_all("", "", "") @command(r'play\s+(%s|\d+)' % WORD, 'play') def play_pl(name): """ Play a playlist by name. """ if name.isdigit(): name = int(name) name = sorted(g.userpl)[name - 1] saved = g.userpl.get(name) if not saved: name = util.get_near_name(name, g.userpl) saved = g.userpl.get(name) if saved: g.model.songs = list(saved.songs) play_all("", "", "") else: g.message = util.F("pl not found") % name g.content = content.playlists_display() @command(r'(%s{0,3})([-,\d\s\[\]]{1,250})\s*(%s{0,3})$' % (RS, RS)) def play(pre, choice, post=""): """ Play choice. Use repeat/random if appears in pre/post. """ # pylint: disable=R0914 # too many local variables # Im just highjacking this if g.content is a # content.Content class if isinstance(g.content, content.Content): play_call = getattr(g.content, "_play", None) if callable(play_call): play_call(pre, choice, post) return if g.browse_mode == "ytpl": if choice.isdigit(): g.selected_pafy_pls_id = g.ytpls[int(choice)-1]['link'] return plist(g.selected_pafy_pls_id) else: g.message = "Invalid playlist selection: %s" % c.y + choice + c.w g.content = content.generate_songlist_display() return if not g.model: g.message = c.r + "There are no tracks to select" + c.w g.content = g.content or content.generate_songlist_display() else: shuffle = "shuffle" in pre + post repeat = "repeat" in pre + post novid = "-a" in pre + post fs = "-f" in pre + post nofs = "-w" in pre + post forcevid = "-v" in pre + post if ((novid and fs) or (novid and nofs) or (nofs and fs) or (novid and forcevid)): raise IOError("Conflicting override options specified") override = False override = "audio" if novid else override override = "fullscreen" if fs else override override = "window" if nofs else override if (not fs) and (not nofs): override = "forcevid" if forcevid else override selection = util.parse_multi(choice) songlist = [g.model[x - 1] for x in selection] # cache next result of displayed items # when selecting a single item if len(songlist) == 1: chosen = selection[0] - 1 if len(g.model) > chosen + 1: streams.preload(g.model[chosen + 1], override=override) if g.scrobble: old_queue = g.scrobble_queue g.scrobble_queue = [g.scrobble_queue[x - 1] for x in selection] try: if not config.PLAYER.get or not util.has_exefile(config.PLAYER.get): g.message = "Player not configured! Enter %sset player "\ "%s to set a player" % (c.g, c.w) return g.PLAYER_OBJ.play(songlist, shuffle, repeat, override) except KeyboardInterrupt: return finally: g.content = content.generate_songlist_display() if g.scrobble: g.scrobble_queue = old_queue if config.AUTOPLAY.get: related(selection.pop()) play(pre, str(random.randint(1, 15)), post="") @command(r'(%s{0,3})(?:\*|all)\s*(%s{0,3})' % (RS, RS)) def play_all(pre, choice, post=""): """ Play all tracks in model (last displayed). shuffle/repeat if req'd.""" options = pre + choice + post play(options, "1-" + str(len(g.model))) @command(r'playurl\s(.*[-_a-zA-Z0-9]{11}[^\s]*)(\s-(?:f|a|w))?', 'playurl') def play_url(url: str, override: T.Any): """Open and play a youtube video url. Args: url: url to be played override: override Raises: SystemExit: If run from command line """ # @fixme check override type hint override = override if override else "_" g.browse_mode = "normal" yt_url(url, print_title=True) if len(g.model) == 1: play(override, "1", "_") if g.command_line: sys.exit() @command(r'browserplay\s(\d{1,50})', 'browserplay') def browser_play(number): """Open a previously searched result in the browser.""" if (len(g.model) == 0): g.message = c.r + "No previous search." + c.w g.content = content.logo(c.r) return try: index = int(number) - 1 if (0 <= index < len(g.model)): base_url = "https://www.youtube.com/watch?v=" video = g.model[index] url = base_url + video.ytid webbrowser.open(url) g.content = g.content or content.generate_songlist_display() else: g.message = c.r + "Out of range." + c.w g.content = g.content or content.generate_songlist_display() return except (HTTPError, URLError, Exception) as e: g.message = c.r + str(e) + c.w g.content = g.content or content.generate_songlist_display() return ================================================ FILE: mps_youtube/commands/search.py ================================================ import base64 import json import logging import math import re import typing as T from argparse import ArgumentParser from datetime import datetime, timedelta from urllib import parse from .. import pafy parser = ArgumentParser() parser.add_argument('-d', '--duration', choices=('any', 'short', 'medium', 'long')) parser.add_argument('-a', '--after') parser.add_argument('-l', '--live', nargs="?", const=True) parser.add_argument('-c', '--category', nargs=1) parser.add_argument('search', nargs='+') from .. import c, config, content, contentquery, g, listview, screen, util from ..playlist import Playlist, Video from . import command from .songlist import paginatesongs, plist ISO8601_TIMEDUR_EX = re.compile(r'PT((\d{1,3})H)?((\d{1,3})M)?((\d{1,2})S)?') DAYS = dict(day = 1, week = 7, month = 30, year = 365) def _display_search_results(progtext, wdata, msg=None, failmsg=None): """ Perform memoized url fetch, display progtext. """ loadmsg = "Searching for '%s%s%s'" % (c.y, progtext, c.w) def iter_songs(): wdata2 = wdata while True: for song in get_tracks_from_json(wdata2): yield song if type(wdata2) is list or not wdata2.get('nextPageToken'): break query = None#wdata2['nextPageToken'] wdata2 = None#pafy.call_gdata('search', qs) # The youtube search api returns a maximum of 500 results length = len(wdata) slicer = util.IterSlicer(iter_songs(), length) paginatesongs(slicer, length=length, msg=msg, failmsg=failmsg, loadmsg=loadmsg) def token(page): """ Returns a page token for a given start index. """ index = (page or 0) * util.getxy().max_results k = index//128 - 1 index -= 128 * k f = [8, index] if k > 0 or index > 127: f.append(k+1) f += [16, 0] b64 = base64.b64encode(bytes(f)).decode('utf8') return b64.strip('=') # def generate_search_qs(term, match='term', videoDuration='any', after=None, category=None, is_live=False): # """ Return query string. """ # # aliases = dict(views='viewCount') # qs = { # 'q': term, # 'maxResults': 50, # 'safeSearch': "none", # 'order': aliases.get(config.ORDER.get, config.ORDER.get), # 'part': 'id,snippet', # 'type': 'video', # 'videoDuration': videoDuration # #,'key': config.API_KEY.get # } # # if after: # after = after.lower() # qs['publishedAfter'] = '%sZ' % (datetime.utcnow() - timedelta(days=DAYS[after])).isoformat() \ # if after in DAYS.keys() else '%s%s' % (after, 'T00:00:00Z' * (len(after) == 10)) # # if match == 'related': # qs['relatedToVideoId'] = term # del qs['q'] # # if config.SEARCH_MUSIC.get: # qs['videoCategoryId'] = 10 # # if category: # qs['videoCategoryId'] = category # # if is_live: # qs['eventType'] = "live" # # return qs def userdata_cached(userterm): """ Check if user name search term found in cache """ userterm = ''.join([t.strip().lower() for t in userterm.split(' ')]) return g.username_query_cache.get(userterm) def cache_userdata(userterm, username, channel_id): """ Cache user name and channel id tuple """ userterm = ''.join([t.strip().lower() for t in userterm.split(' ')]) g.username_query_cache[userterm] = (username, channel_id) util.dbg('Cache data for username search query "{}": {} ({})'.format( userterm, username, channel_id)) while len(g.username_query_cache) > 300: g.username_query_cache.popitem(last=False) return (username, channel_id) def channelfromname(user): """ Query channel id from username. """ cached = userdata_cached(user) if cached: return cached try: channel_id, channel_name = pafy.channel_id_from_name(user) return cache_userdata(user, channel_name, channel_id) except Exception as e: import traceback traceback.print_exception(type(e), e, e.__traceback__) g.message = "Could not retrieve information for user {}\n{}".format( c.y + user + c.w, e) util.dbg('Error during channel request for user {}:\n{}'.format( user, e)) # at this point, we know the channel id associated to a user name return None @command(r'channels\s+(.+)') def channelsearch(q_user): # qs = {'part': 'id,snippet', # 'q': q_user, # 'maxResults': 50, # 'type': 'channel', # 'order': "relevance" # } QueryObj = contentquery.ContentQuery(listview.ListUser, 'search', q_user) columns = [ {"name": "idx", "size": 3, "heading": "Num"}, {"name": "name", "size": 30, "heading": "Username"}, {"name": "description", "size": "remaining", "heading": "Description"}, ] def run_m(user_id): """ Search ! """ usersearch_id(*(user_id[0])) del g.content g.content = listview.ListView(columns, QueryObj, run_m) g.message = "Results for channel search: '%s'" % q_user @command(r'user\s+(.+)', 'user') def usersearch(q_user, identify='forUsername'): """ Fetch uploads by a YouTube user. """ user, _, term = (x.strip() for x in q_user.partition("/")) if identify == 'forUsername': ret = channelfromname(user) if not ret: # Error return user, channel_id = ret else: channel_id = user # at this point, we know the channel id associated to a user name usersearch_id(user, channel_id, term) def usersearch_id(user, channel_id, term): """ Performs a search within a user's (i.e. a channel's) uploads for an optional search term with the user (i.e. the channel) identified by its ID """ #query = generate_search_qs(term) aliases = dict(views='viewCount') # The value of the config item is 'views' not 'viewCount' if config.USER_ORDER.get: pass #query['order'] = aliases.get(config.USER_ORDER.get, # config.USER_ORDER.get) #query['channelId'] = channel_id termuser = tuple([c.y + x + c.w for x in (term, user)]) if term: msg = "Results for {1}{3}{0} (by {2}{4}{0})" progtext = "%s by %s" % termuser failmsg = "No matching results for %s (by %s)" % termuser else: msg = "Video uploads by {2}{4}{0}" progtext = termuser[1] if config.SEARCH_MUSIC: failmsg = """User %s not found or has no videos in the Music category. Use 'set search_music False' to show results not in the Music category.""" % termuser[1] else: failmsg = "User %s not found or has no videos." % termuser[1] msg = str(msg).format(c.w, c.y, c.y, term, user) results = pafy.all_videos_from_channel(channel_id) _display_search_results(progtext, results, msg, failmsg) def related_search(vitem): """ Fetch videos related to vitem vitem = {'description': str, 'length': int, 'title': str, 'ytid': str} """ t = vitem.title ttitle = t[:48].strip() + ".." if len(t) > 49 else t msg = "Videos related to %s%s%s" % (c.y, ttitle, c.w) failmsg = "Related to %s%s%s not found" % (c.y, vitem.ytid, c.w) # todo: implement realted search in pafy #_search(ttitle, vitem.title, msg, failmsg) # Livestream category search @command(r'live\s+(.+)', 'live') def livestream_category_search(term): sel_category = g.categories.get(term, None) if not sel_category: g.message = ("That is not a valid category. Valid categories are: ") g.message += (", ".join(g.categories.keys())) return query = { "part": "id,snippet", "eventType": "live", "maxResults": 50, "type": "video", "videoCategoryId": sel_category } query_obj = contentquery.ContentQuery(listview.ListLiveStream, 'search', query) columns = [ {"name": "idx", "size": 3, "heading": "Num"}, {"name": "title", "size": 40, "heading": "Title"}, {"name": "description", "size": "remaining", "heading": "Description"}, ] def start_stream(returned): songs = Playlist("Search Results", [Video(*x) for x in returned]) if not config.PLAYER.get or not util.has_exefile(config.PLAYER.get): g.message = "Player not configured! Enter %sset player "\ "%s to set a player" % (c.g, c.w) return g.PLAYER_OBJ.play(songs, False, False, False) g.content = listview.ListView(columns, query_obj, start_stream) g.message = "Livestreams in category: '%s'" % term # Note: [^./] is to prevent overlap with playlist search command @command(r'(?:search|\.|/)\s*([^./].{1,500})', 'search') def search(term): """ Perform search. """ try: # TODO make use of unknowns args, unknown = parser.parse_known_args(term.split()) video_duration = args.duration if args.duration else 'any' if args.category: if not args.category[0].isdigit(): args.category = g.categories.get(args.category[0]) else: args.category = "".join(args.category) after = args.after term = ' '.join(args.search) except SystemExit: # <------ argsparse calls exit() g.message = c.b + "Bad syntax. Enter h for help" + c.w return if not term or len(term) < 2: g.message = c.r + "Not enough input" + c.w g.content = content.generate_songlist_display() return logging.info("search for %s", term) #query = generate_search_qs(term, videoDuration=video_duration, after=after, category=args.category, is_live=args.live) msg = "Search results for %s%s%s" % (c.y, term, c.w) failmsg = "Found nothing for %s%s%s" % (c.y, term, c.w) wdata = pafy.search_videos(term, int(config.PAGES.get)) _display_search_results(term, wdata, msg, failmsg) @command(r'u(?:ser)?pl\s(.*)', 'userpl', 'upl') def user_pls(user): """ Retrieve user playlists. """ return pl_search(user, is_user=True) @command(r'(?:\.\.|\/\/|pls(?:earch)?\s)\s*(.*)', 'plsearch') def pl_search(term, page=0, splash=True, is_user=False): """ Search for YouTube playlists. term can be query str or dict indicating user playlist search. """ if not term or len(term) < 2: g.message = c.r + "Not enough input" + c.w g.content = content.generate_songlist_display() return if splash: g.content = content.logo(c.g) prog = "user: " + term if is_user else term g.message = "Searching playlists for %s" % c.y + prog + c.w screen.update() logging.info("playlist search for %s", prog) if is_user: ret = channelfromname(term) if not ret: return user, channel_id = ret pldata = pafy.all_playlists_from_channel(channel_id) else: pldata = pafy.playlist_search(term) playlists = get_pl_from_json(pldata)[:util.getxy().max_results] if playlists: g.last_search_query = (pl_search, {"term": term, "is_user": is_user}) g.browse_mode = "ytpl" g.current_page = page g.result_count = len(pldata) g.ytpls = playlists g.message = "Playlist results for %s" % c.y + prog + c.w g.content = content.generate_playlist_display() else: g.message = "No playlists found for: %s" % c.y + prog + c.w g.current_page = 0 g.content = content.generate_songlist_display(zeromsg=g.message) def get_pl_from_json(pldata): """ Process json playlist data. """ try: items = pldata except KeyError: items = [] results = [] for item in items: results.append(dict( link=item["id"], size=item["videoCount"], title=item["title"], author= item['channel']["name"] if 'channel' in item.keys() else None, created=item.get("publishedAt"), updated=item.get('publishedAt'), #XXX Not available in API? description=item.get("description"))) return results def get_track_id_from_json(item): """ Try to extract video Id from various response types """ fields = ['contentDetails/videoId', 'snippet/resourceId/videoId', 'id/videoId', 'id'] for field in fields: node = item for p in field.split('/'): if node and isinstance(node, dict): node = node.get(p) if node: return node return '' def get_tracks_from_json(jsons): """ Get search results from API response """ if len(jsons) == 0: util.dbg("got unexpected data or no search results") return () # populate list of video objects songs = [] for item in jsons: try: ytid = get_track_id_from_json(item) duration = util.parse_video_length(item.get('duration')) #stats = item.get('statistics', {}) #snippet = item.get('snippet', {}) title = item.get('title', '').strip() # instantiate video representation in local model cursong = Video(ytid=ytid, title=title, length=duration) dislike_data = {'likes': 0, 'dislikes':0, 'rating':0}#pafy.return_dislikes(ytid) likes = int(dislike_data['likes']) dislikes = int(dislike_data['dislikes']) # this is a very poor attempt to calculate a rating value rating = int(dislike_data['rating'])#5.*likes/(likes+dislikes) if (likes+dislikes) > 0 else 0 category = '?'#snippet.get('categoryId') publishedlocaldatetime = item.get('publishedTime','?')#util.yt_datetime_local(snippet.get('publishedAt', '')) # cache video information in custom global variable store g.meta[ytid] = dict( # tries to get localized title first, fallback to normal title title=title, length=str(util.fmt_time(cursong.length)), rating=rating,#str('{}'.format(rating))[:4].ljust(4, "0"), uploader=item['channel']['id'], uploaderName=item['channel']['name'], category=category, aspect="custom", #XXX uploaded=publishedlocaldatetime,#publishedlocaldatetime[1] if publishedlocaldatetime is not None else None, uploadedTime=publishedlocaldatetime,#,publishedlocaldatetime[2] if publishedlocaldatetime is not None else None, likes=str(num_repr(likes)), dislikes=str(num_repr(dislikes)), commentCount='?',#str(num_repr(int(stats.get('commentCount', 0)))), viewCount= item['viewCount']['text'] if 'viewCount' in item.keys() else '?')#str(num_repr(int(stats.get('viewCount', 0))))) songs.append(cursong) except Exception as e: import traceback traceback.print_exception(type(e), e, e.__traceback__) input('Press any key to continue...') util.dbg(json.dumps(item, indent=2)) util.dbg('Error during metadata extraction/instantiation of ' + 'search result {}\n{}'.format(ytid, e)) # return video objects return songs def num_repr(num): """ Return up to four digit string representation of a number, eg 2.6m. """ if num <= 9999: return str(num) def digit_count(x): """ Return number of digits. """ return int(math.floor(math.log10(x)) + 1) digits = digit_count(num) sig = 3 if digits % 3 == 0 else 2 rounded = int(round(num, int(sig - digits))) digits = digit_count(rounded) suffix = "_kmBTqXYX"[(digits - 1) // 3] front = 3 if digits % 3 == 0 else digits % 3 if not front == 1: return str(rounded)[0:front] + suffix return str(rounded)[0] + "." + str(rounded)[1] + suffix @command(r'u\s?([\d]{1,4})', 'u') def user_more(num): """ Show more videos from user of vid num. """ if g.browse_mode != "normal": g.message = "User uploads must refer to a specific video item" g.message = c.y + g.message + c.w g.content = content.generate_songlist_display() return g.current_page = 0 item = g.model[int(num) - 1] #TODO: Cleaner way of doing this? if item.ytid in g.meta: channel_id = g.meta.get(item.ytid, {}).get('uploader') user = g.meta.get(item.ytid, {}).get('uploaderName') else: paf = util.get_pafy(item) user, channel_id = channelfromname(paf.author) usersearch_id(user, channel_id, '') @command(r'r\s?(\d{1,4})', 'r') def related(num): """ Show videos related to to vid num. """ if g.browse_mode != "normal": g.message = "Related items must refer to a specific video item" g.message = c.y + g.message + c.w g.content = content.generate_songlist_display() return g.current_page = 0 item = g.model[int(num) - 1] related_search(item) @command(r'mix\s*(\d{1,4})', 'mix') def mix(num): """ Retrieves the YouTube mix for the selected video. """ g.content = g.content or content.generate_songlist_display() if g.browse_mode != "normal": g.message = util.F('mix only videos') else: item = (g.model[int(num) - 1]) if item is None: g.message = util.F('invalid item') return item = util.get_pafy(item) # Mix playlists are made up of 'RD' + video_id try: plist("RD" + item.videoid) except OSError: g.message = util.F('no mix') @command(r"url\s(.*[-_a-zA-Z0-9]{11}.*)", "url") def yt_url(url: str, print_title: bool = False): """ Acess videos by urls. If `print_title` is true only last title from unique parsed id will be printed. If for example `vid1` and `vid2` have title `title1` and `title2`, respectively, `yt_url('vid1 vid2 vid1', True)` will print `title2` from `vid2` instead `title1` from last entry `vid1`. Args: url: youtube url print_title: print title or not """ url_list = url.split() g.model.songs = [] v_ids = set() v_title = None for url in url_list: try: v_id = pafy.extract_video_id(url) if v_id in v_ids: continue p = pafy.get_video_info(v_id) except (IOError, ValueError) as e: g.message = c.r + str(e) + c.w g.content = g.content or content.generate_songlist_display( zeromsg=g.message) return g.browse_mode = "normal" v = Video(p['id'], p['title'], int(p['duration']['secondsText'])) if p and isinstance(p, dict): v_title = p.get("title") g.model.songs.append(v) v_ids.add(v_id) if not g.command_line: g.content = content.generate_songlist_display() if print_title and v_title: util.xprint(v_title) @command(r'url_file\s(\S+)', 'url_file') def yt_url_file(file_name): """ Access a list of urls in a text file """ #Open and read the file try: with open(file_name, "r") as fo: output = ' '.join([line.strip() for line in fo if line.strip()]) except (IOError): g.message = c.r + 'Error while opening the file, check the validity of the path' + c.w g.content = g.content or content.generate_songlist_display( zeromsg=g.message) return #Finally pass the input to yt_url yt_url(output) ================================================ FILE: mps_youtube/commands/songlist.py ================================================ import math import random from .. import g, c, screen, streams, content, util, pafy from ..playlist import Video from . import command, PL def paginatesongs(func, page=0, splash=True, dumps=False, length=None, msg=None, failmsg=None, loadmsg=None): """ A utility function for handling lists of songs, so that the pagination and the dump command will work properly. :param func: Either a function taking a start and end index, or a slicable object. Either way, it should produce an iterable of :class:`mps_youtube.playlist.Video` objects. :param page: The page number to display :param splash: Whether or not to display a splash screen while loading. :param dumps: Used by :func:`dump` command to load all songs, instead of only those that fit on a page :param length: The total number of songs. It it is not provided, ``len(func)`` will be used instead. :param msg: Message to display after loading successfully :param failmsg: Message to display on failure (if no songs are returned by func :param loadmsg: Message to display while loading :type page: int :type splash: bool :type dumps: bool :type length: int :type msg: str :type failmsg: str :type loadmsg: str """ if splash: g.message = loadmsg or '' g.content = content.logo(col=c.b) screen.update() max_results = util.getxy().max_results if dumps: s = 0 e = None else: s = page * max_results e = (page + 1) * max_results if callable(func): songs = func(s, e) else: songs = func[s:e] if length is None: length = len(func) args = {'func':func, 'length':length, 'msg':msg, 'failmsg':failmsg, 'loadmsg': loadmsg} g.last_search_query = (paginatesongs, args) g.browse_mode = "normal" g.current_page = page g.result_count = length g.model.songs = songs g.content = content.generate_songlist_display() g.last_opened = "" g.message = msg or '' if not songs: g.message = failmsg or g.message if songs: # preload first result url streams.preload(songs[0], delay=0) @command(r'pl\s+%s' % PL, 'pl') def plist(parturl): """ Retrieve YouTube playlist. """ if parturl in g.pafy_pls: ytpl, plitems = g.pafy_pls[parturl] else: util.dbg("%sFetching playlist using pafy%s", c.y, c.w) ytpl = pafy.get_playlist(parturl) plitems = util.IterSlicer(ytpl.videos) g.pafy_pls[parturl] = (ytpl, plitems) def pl_seg(s, e): return [Video(i['id'], i['title'], util.parse_video_length(i['duration'])) for i in plitems[s:e]] msg = "Showing YouTube playlist %s" % (c.y + ytpl.info['info']['title'] + c.w) loadmsg = "Retrieving YouTube playlist" paginatesongs(pl_seg, length=len(ytpl.videos), msg=msg, loadmsg=loadmsg) @command(r'(rm|add)\s*(-?\d[-,\d\s]{,250})', 'rm', 'add') def songlist_rm_add(action, songrange): """ Remove or add tracks. works directly on user input. """ selection = util.parse_multi(songrange) if action == "add": duplicate_songs = [] for songnum in selection: if g.model[songnum - 1] in g.active: duplicate_songs.append(str(songnum)) g.active.songs.append(g.model[songnum - 1]) d = g.active.duration g.message = util.F('added to pl') % (len(selection), len(g.active), d) if duplicate_songs: duplicate_songs = ', '.join(sorted(duplicate_songs)) g.message += '\n' g.message += util.F('duplicate tracks') % duplicate_songs elif action == "rm": selection = sorted(set(selection), reverse=True) removed = str(tuple(reversed(selection))).replace(",", "") for x in selection: g.model.songs.pop(x - 1) try: g.active.songs.pop(g.current_page * util.getxy().max_results + x - 1) except IndexError: pass g.message = util.F('songs rm') % (len(selection), removed) g.content = content.generate_songlist_display() @command(r'(mv|sw)\s*(\d{1,4})\s*[\s,]\s*(\d{1,4})', 'mv', 'sw') def songlist_mv_sw(action, a, b): """ Move a song or swap two songs. """ i, j = int(a) - 1, int(b) - 1 if action == "mv": g.model.songs.insert(j, g.model.songs.pop(i)) g.message = util.F('song move') % (g.model[j].title, b) elif action == "sw": g.model[i], g.model[j] = g.model[j], g.model[i] g.message = util.F('song sw') % (min(a, b), max(a, b)) g.content = content.generate_songlist_display() @command(r'(n|p)\s*(\d{1,2})?') def nextprev(np, page=None): """ Get next / previous search results. """ if isinstance(g.content, content.PaginatedContent): page_count = g.content.numPages() function = g.content.getPage args = {} else: page_count = math.ceil(g.result_count/util.getxy().max_results) function, args = g.last_search_query good = False if function: if np == "n": if g.current_page + 1 < page_count: g.current_page += 1 good = True elif np == "p": if page and int(page) in range(1,20): g.current_page = int(page)-1 good = True elif g.current_page > 0: g.current_page -= 1 good = True if good: function(page=g.current_page, **args) else: norp = "next" if np == "n" else "previous" g.message = "No %s items to display" % norp if not isinstance(g.content, content.PaginatedContent): g.content = content.generate_songlist_display() return good @command(r'(un)?dump', 'dump', 'undump') def dump(un): """ Show entire playlist. """ func, args = g.last_search_query if func is paginatesongs: paginatesongs(dumps=(not un), **args) else: un = "" if not un else un g.message = "%s%sdump%s may only be used on an open YouTube playlist" g.message = g.message % (c.y, un, c.w) g.content = content.generate_songlist_display() @command(r'shuffle', 'shuffle') def shuffle_fn(): """ Shuffle displayed items. """ random.shuffle(g.model.songs) g.message = c.y + "Items shuffled" + c.w g.content = content.generate_songlist_display() @command(r'shuffle all', 'shuffle all') def shuffle_playlist(): """ Shuffle entire loaded playlist. """ songs = content.get_last_query() if songs: random.shuffle(songs) paginatesongs(list(songs)) g.message = c.y + "Shuffled entire playlist" + c.w g.content = content.generate_songlist_display() @command(r'reverse', 'reverse') def reverse_songs(): """ Reverse order of displayed items. """ g.model.songs = g.model.songs[::-1] g.message = c.y + "Reversed displayed songs" + c.w g.content = content.generate_songlist_display() @command(r'reverse\s*(\d{1,4})\s*-\s*(\d{1,4})\s*', 'reverse') def reverse_songs_range(lower, upper): """ Reverse the songs within a specified range. """ lower, upper = int(lower), int(upper) if lower > upper: lower, upper = upper, lower g.model.songs[lower-1:upper] = reversed(g.model.songs[lower-1:upper]) g.message = c.y + "Reversed range: " + str(lower) + "-" + str(upper) + c.w g.content = content.generate_songlist_display() @command(r'reverse all', 'reverse all') def reverse_playlist(): """ Reverse order of entire loaded playlist. """ songs = content.get_last_query() if songs: paginatesongs(list(reversed(songs))) g.message = c.y + "Reversed entire playlist" + c.w g.content = content.generate_songlist_display() ================================================ FILE: mps_youtube/commands/spotify_playlist.py ================================================ import re import time import difflib try: # pylint: disable=F0401 import spotipy import spotipy.oauth2 as oauth2 has_spotipy = True except ImportError: has_spotipy = False from .. import c, g, screen, __version__, __url__, content, config, util from . import command from .songlist import paginatesongs from .search import get_tracks_from_json def generate_credentials(): """Generate the token. Please respect these credentials :)""" credentials = oauth2.SpotifyClientCredentials( client_id='6451e12933bb49ed8543d41e3296a88d', client_secret='40ef54678fe441bd9acd66f5d5c34e69') return credentials def grab_playlist(spotify, playlist): if '/' in playlist: if playlist.endswith('/'): playlist = playlist[:-1] splits = playlist.split('/') else: splits = playlist.split(':') username = splits[-3] playlist_id = splits[-1] results = spotify.user_playlist(username, playlist_id, fields='tracks,next,name,owner') all_tracks = [] tracks = results['tracks'] while True: for item in tracks['items']: track = item['track'] try: all_tracks.append(track) except KeyError: pass # 1 page = 50 results # check if there are more pages if tracks['next']: tracks = spotify.next(tracks) else: break return (results, all_tracks) def show_message(message, col=c.r, update=False): """ Show message using col, update screen if required. """ g.content = content.generate_songlist_display() g.message = col + message + c.w if update: screen.update() def _best_song_match(songs, title, duration, titleweight, durationweight): """ Select best matching song based on title, length. Score from 0 to 1 where 1 is best. titleweight and durationweight parameters added to enable function usage when duration can't be guessed """ # pylint: disable=R0914 seqmatch = difflib.SequenceMatcher def variance(a, b): """ Return difference ratio. """ return float(abs(a - b)) / max(a, b) candidates = [] ignore = "music video lyrics new lyrics video audio".split() extra = "official original vevo".split() for song in songs: dur, tit = int(song.length), song.title util.dbg("Title: %s, Duration: %s", tit, dur) for word in extra: if word in tit.lower() and word not in title.lower(): pattern = re.compile(word, re.I) tit = pattern.sub("", tit) for word in ignore: if word in tit.lower() and word not in title.lower(): pattern = re.compile(word, re.I) tit = pattern.sub("", tit) replacechars = re.compile(r"[\]\[\)\(\-]") tit = replacechars.sub(" ", tit) multiple_spaces = re.compile(r"(\s)(\s*)") tit = multiple_spaces.sub(r"\1", tit) title_score = seqmatch(None, title.lower(), tit.lower()).ratio() duration_score = 1 - variance(duration, dur) util.dbg("Title score: %s, Duration score: %s", title_score, duration_score) # apply weightings score = duration_score * durationweight + title_score * titleweight candidates.append((score, song)) best_score, best_song = max(candidates, key=lambda x: x[0]) percent_score = int(100 * best_score) return best_song, percent_score def _match_tracks(tracks): """ Match list of tracks by performing multiple searches. """ # pylint: disable=R0914 def dtime(x): """ Format time to M:S. """ return time.strftime('%M:%S', time.gmtime(int(x))) # do matching for track in tracks: ttitle = track['name'] artist = track['artists'][0]['name'] length = track['duration_ms']/1000 util.xprint("Search : %s%s - %s%s - %s" % (c.y, artist, ttitle, c.w, dtime(length))) q = "%s %s" % (artist, ttitle) w = q = ttitle if artist == "Various Artists" else q query = w#generate_search_qs(w, 0) util.dbg(query) # perform fetch wdata = None#pafy.call_gdata('search', query) results = get_tracks_from_json(wdata) if not results: util.xprint(c.r + "Nothing matched :(\n" + c.w) continue s, score = _best_song_match( results, artist + " " + ttitle, length, .5, .5) cc = c.g if score > 85 else c.y cc = c.r if score < 75 else cc util.xprint("Matched: %s%s%s - %s \n[%sMatch confidence: " "%s%s]\n" % (c.y, s.title, c.w, util.fmt_time(s.length), cc, score, c.w)) yield s @command(r'suser\s*(.*[-_a-zA-Z0-9].*)?', 'suser') def search_user(term): """Search for Spotify user playlists. """ # pylint: disable=R0914,R0912 if has_spotipy: if not term: show_message("Enter username:", c.g, update=True) term = input("> ") if not term or len(term) < 2: g.message = c.r + "Not enough input!" + c.w g.content = None#content.generate_songlist_display() return credentials = generate_credentials() token = credentials.get_access_token() spotify = spotipy.Spotify(auth=token) playlists = spotify.user_playlists(term) links = [] check = 1 g.content = "Playlists:\n" while True: for playlist in playlists['items']: if playlist['name'] is not None: g.content += (u'{0:>2}. {1:<30} ({2} tracks)'.format( check, playlist['name'], playlist['tracks']['total'])) g.content += "\n" links.append(playlist) check += 1 if playlists['next']: playlists = spotify.next(playlists) else: break g.message = c.g + "Choose your playlist:" + c.w screen.update() choice = int(input("> ")) playlist = links[choice-1] search_playlist(playlist['external_urls']['spotify'], spotify=spotify) else: g.message = "spotipy module must be installed for Spotify support\n" g.message += "see https://pypi.python.org/pypi/spotipy/" @command(r'splaylist\s*(.*[-_a-zA-Z0-9].*)?', 'splaylist') def search_playlist(term, spotify=None): """Search for Spotify playlist. """ # pylint: disable=R0914,R0912 if has_spotipy: if not term: show_message("Enter playlist url:", c.g, update=True) term = input("> ") if not term or len(term) < 2: g.message = c.r + "Not enough input!" + c.w g.content = None#content.generate_songlist_display() return if not spotify: credentials = generate_credentials() token = credentials.get_access_token() spotify = spotipy.Spotify(auth=token) try: playlist, tracks = grab_playlist(spotify, term) except TypeError: tracks = None if not tracks: show_message("Playlist '%s' not found!" % term) return if not playlist['tracks']['total']: show_message("Playlist '%s' by '%s' has 0 tracks!" % (playlist['name'], playlist['owner']['id'])) return msg = "%s%s%s by %s%s%s\n\n" % (c.g, playlist['name'], c.w, c.g, playlist['owner']['id'], c.w) msg += "Enter to begin matching or [q] to abort" g.message = msg g.content = "Tracks:\n" for n, track in enumerate(tracks, 1): trackname = '{0:<20} - {1}'.format(track['artists'][0]['name'], track['name']) g.content += "%03s %s" % (n, trackname) g.content += "\n" screen.update() entry = input("Continue? [Enter] > ") if entry == "": pass else: show_message("Playlist search abandoned!") return songs = [] screen.clear() itt = _match_tracks(tracks) stash = config.SEARCH_MUSIC.get, config.ORDER.get config.SEARCH_MUSIC.value = True config.ORDER.value = "relevance" try: songs.extend(itt) except KeyboardInterrupt: util.xprint("%sHalted!%s" % (c.r, c.w)) finally: config.SEARCH_MUSIC.value, config.ORDER.value = stash if songs: util.xprint("\n%s / %s songs matched" % (len(songs), len(tracks))) input("Press Enter to continue") msg = "Contents of playlist %s%s - %s%s %s(%d/%d)%s:" % ( c.y, playlist['owner']['id'], playlist['name'], c.w, c.b, len(songs), len(tracks), c.w) failmsg = "Found no playlist tracks for %s%s%s" % (c.y, playlist['name'], c.w) paginatesongs(songs, msg=msg, failmsg=failmsg) else: g.message = "spotipy module must be installed for Spotify support\n" g.message += "see https://pypi.python.org/pypi/spotipy/" ================================================ FILE: mps_youtube/config.py ================================================ import os import re import sys import copy import pickle import json from urllib.request import urlopen from urllib.error import HTTPError from urllib.parse import urlencode try: import pylast has_pylast = True except ImportError: has_pylast = False from . import g, c, paths, util mswin = os.name == "nt" class ConfigItem: """ A configuration item. """ def __init__(self, name, value, minval=None, maxval=None, check_fn=None, require_known_player=False, allowed_values=None): """ If specified, the check_fn should return a dict. {valid: bool, message: success/fail mesage, value: value to set} """ self.default = self.value = value self.temp_value = None self.name = name self.type = type(value) self.maxval, self.minval = maxval, minval self.check_fn = check_fn self.require_known_player = require_known_player self.allowed_values = [] if allowed_values: self.allowed_values = allowed_values @property def get(self): """ Return value. """ if self.temp_value is None: return self.value else: return self.temp_value @property def display(self): """ Return value in a format suitable for display. """ return self.display_helper(self.value) @property def display_temp(self): if self.temp_value is None: return "" return self.display_helper(self.temp_value) def display_helper(self, retval): if self.name == "max_res": retval = str(retval) + "p" if self.name == "encoder": retval = str(retval) + " [%s]" % (str(g.encoders[retval]['name'])) return retval def set(self, value, is_temp=False): """ Set value with checks. """ # note: fail_msg should contain %s %s for self.name, value # success_msg should not # pylint: disable=R0912 # too many branches success_msg = fail_msg = "" value = value.strip() value_orig = value # handle known player not set if self.allowed_values and value not in self.allowed_values: fail_msg = "%s must be one of * - not %s" allowed_values = copy.copy(self.allowed_values) if '' in allowed_values: allowed_values[allowed_values.index('')] = "" fail_msg = fail_msg.replace("*", ", ".join(allowed_values)) if self.require_known_player and \ not util.is_known_player(Config.PLAYER.get): fail_msg = "%s requires mpv or mplayer, can't set to %s" # handle true / false values elif self.type == bool: if value.upper() in "0 OFF NO DISABLED FALSE".split(): value = False success_msg = "%s set to False" % c.c("g", self.name) elif value.upper() in "1 ON YES ENABLED TRUE".split(): value = True success_msg = "%s set to True" % c.c("g", self.name) else: fail_msg = "%s requires True/False, got %s" # handle int values elif self.type == int: if not value.isdigit(): fail_msg = "%s requires a number, got %s" else: value = int(value) if self.maxval and self.minval: if not self.minval <= value <= self.maxval: m = " must be between %s and %s, got " m = m % (self.minval, self.maxval) fail_msg = "%s" + m + "%s" if not fail_msg: dispval = value or "None" success_msg = "%s set to %s" % (c.c("g", self.name), dispval) # handle space separated list elif self.type == list: success_msg = "%s set to %s" % (c.c("g", self.name), value) value = value.split() # handle string values elif self.type == str: dispval = value or "None" success_msg = "%s set to %s" % (c.c("g", self.name), c.c("g", dispval)) # handle failure if fail_msg: failed_val = value_orig.strip() or "" colvals = c.y + self.name + c.w, c.y + failed_val + c.w return fail_msg % colvals elif self.check_fn: checked = self.check_fn(value) value = checked.get("value") or value if checked['valid']: value = checked.get("value", value) set_save(self, value, is_temp) return checked.get("message", success_msg) else: return checked.get('message', fail_msg) elif success_msg: set_save(self, value, is_temp) return success_msg def set_save(self, value, is_temp): if not is_temp: self.temp_value = None self.value = value Config.save() else: self.temp_value = value def check_console_width(val): """ Show ruler to check console width. """ valid = True message = "-" * val + "\n" message += "console_width set to %s, try a lower value if above line ove"\ "rlaps" % val return dict(valid=valid, message=message) # def check_api_key(key): # """ Validate an API key by calling an API endpoint with no quota cost """ # url = "https://www.googleapis.com/youtube/v3/i18nLanguages" # query = {"part": "snippet", "fields": "items/id", "key": key} # try: # urlopen(url + "?" + urlencode(query)).read() # message = "The key, '" + key + "' will now be used for API requests." # # # Make pafy use the same api key # pafy.set_api_key(Config.API_KEY.get) # # return dict(valid=True, message=message) # except HTTPError: # message = "Invalid key or quota exceeded, '" + key + "'" # return dict(valid=False, message=message) def check_ddir(d): """ Check whether dir is a valid directory. """ expanded = os.path.expanduser(d) if os.path.isdir(expanded): message = "Downloads will be saved to " + c.y + d + c.w return dict(valid=True, message=message, value=expanded) else: message = "Not a valid directory: " + c.r + d + c.w return dict(valid=False, message=message) def check_win_pos(pos): """ Check window position input. """ if not pos.strip(): return dict(valid=True, message="Window position not set (default)") pos = pos.lower() reg = r"(TOP|BOTTOM).?(LEFT|RIGHT)" if not re.match(reg, pos, re.I): msg = "Try something like top-left or bottom-right (or default)" return dict(valid=False, message=msg) else: p = re.match(reg, pos, re.I).groups() p = "%s-%s" % p msg = "Window position set to %s" % p return dict(valid=True, message=msg, value=p) def check_win_size(size): """ Check window size input. """ if not size.strip(): return dict(valid=True, message="Window size not set (default)") size = size.lower() reg = r"\d{1,4}x\d{1,4}" if not re.match(reg, size, re.I): msg = "Try something like 720x480" return dict(valid=False, message=msg) else: return dict(valid=True, value=size) def check_encoder(option): """ Check encoder value is acceptable. """ encs = g.encoders if option >= len(encs): message = "%s%s%s is too high, type %sencoders%s to see valid values" message = message % (c.y, option, c.w, c.g, c.w) return dict(valid=False, message=message) else: message = "Encoder set to %s%s%s" message = message % (c.y, encs[option]['name'], c.w) return dict(valid=True, message=message) def check_player(player): """ Check player exefile exists and get mpv version. """ if util.has_exefile(player): print(player) util.assign_player(player) if "mpv" in player: version = "%s.%s.%s" % g.mpv_version fmt = c.g, c.w, c.g, c.w, version msg = "%splayer%s set to %smpv%s (version %s)" % fmt return dict(valid=True, message=msg, value=player) else: msg = "%splayer%s set to %s%s%s" % (c.g, c.w, c.g, player, c.w) return dict(valid=True, message=msg, value=player) else: if mswin and not (player.endswith(".exe") or player.endswith(".com")): # Using mpv.exe has issues; use mpv.com if "mpv" in player: retval = check_player(player + ".com") if retval["valid"]: return retval return check_player(player + ".exe") else: msg = "Player application %s%s%s not found" % (c.r, player, c.w) return dict(valid=False, message=msg) def check_lastfm_password(password): if not has_pylast: msg = "pylast not installed" return dict(valid=False, message=msg) password_hash = pylast.md5(password) return dict(valid=True, value=password_hash) class _Config: """ Holds various configuration values. """ _configitems = [ ConfigItem("order", "relevance", allowed_values="relevance date views rating title".split()), ConfigItem("user_order", "", allowed_values = [""] + "relevance date views rating".split()), ConfigItem("max_results", 19, maxval=50, minval=1), ConfigItem("console_width", 80, minval=70, maxval=880, check_fn=check_console_width), ConfigItem("max_res", 2160, minval=360, maxval=2160), ConfigItem("player", "vlc" + ".exe" * mswin, check_fn=check_player), ConfigItem("playerargs", ""), ConfigItem("encoder", 0, minval=0, check_fn=check_encoder), ConfigItem("notifier", ""), ConfigItem("checkupdate", True), ConfigItem("show_player_keys", True, require_known_player=True), ConfigItem("fullscreen", False, require_known_player=True), ConfigItem("show_status", True), ConfigItem("always_repeat", False), ConfigItem("columns", "date user"), ConfigItem("ddir", paths.get_default_ddir(), check_fn=check_ddir), ConfigItem("overwrite", True), ConfigItem("show_video", True), ConfigItem("search_music", False), ConfigItem("window_pos", "", check_fn=check_win_pos, require_known_player=True), ConfigItem("window_size", "", check_fn=check_win_size, require_known_player=True), ConfigItem("download_command", ''), ConfigItem("lookup_metadata", True), ConfigItem("lastfm_username", ''), ConfigItem("lastfm_password", '', check_fn=check_lastfm_password), ConfigItem("lastfm_api_key", ''), ConfigItem("lastfm_api_secret", ''), ConfigItem("audio_format", "auto", allowed_values="auto webm m4a".split()), ConfigItem("video_format", "auto", allowed_values="auto webm mp4 3gp".split()), ConfigItem("pages", 3, minval=1, maxval=100), ConfigItem("autoplay", False), ConfigItem("set_title", True), ConfigItem("mpris", not mswin), ConfigItem("show_qrcode", False), ConfigItem("history", True), ConfigItem("input_history", True), ConfigItem("vlc_dummy_interface", False) ] def __getitem__(self, key): # TODO: Possibly more efficient algorithm, w/ caching for i in self._configitems: if i.name.upper() == key: return i raise KeyError def __getattr__(self, name): try: # todo: remove this later if name != 'API_KEY': return self[name] except KeyError: raise AttributeError def __iter__(self): return (i.name.upper() for i in self._configitems) def save(self): """ Save current config to file. """ config = {setting: self[setting].value for setting in self} with open(g.CFFILE, "w") as cf: json.dump(config, cf, indent=2) util.dbg(c.p + "Saved config: " + g.CFFILE + c.w) def convert_old_cf_to_json(self): """ check if old-style config exists, convert old-style pickled binary config to json and save to disk, delete old-style config """ if os.path.exists(g.OLD_CFFILE): with open(g.OLD_CFFILE, "rb") as cf: with open(g.CFFILE, "w") as cfj: json.dump(pickle.load(cf), cfj, indent=2) os.remove(g.OLD_CFFILE) def load(self): """ Override config if config file exists. """ if os.path.exists(g.CFFILE): with open(g.CFFILE, "r") as cf: saved_config = json.load(cf) for k, v in saved_config.items(): try: self[k].value = v except KeyError: # Ignore unrecognised data in config util.dbg("Unrecognised config item: %s", k) # Update config files from versions <= 0.01.41 if isinstance(self.PLAYERARGS.get, list): self.WINDOW_POS.value = "top-right" redundant = ("-really-quiet --really-quiet -prefer-ipv4 -nolirc " "-fs --fs".split()) for r in redundant: util.dbg("removing redundant arg %s", r) util.list_update(r, self.PLAYERARGS.value, remove=True) self.PLAYERARGS.value = " ".join(self.PLAYERARGS.get) self.save() Config = _Config() del _Config # _Config is a singleton and should not have more instances # Prevent module from being deleted # http://stackoverflow.com/questions/5365562/why-is-the-value-of-name-changing-after-assignment-to-sys-modules-name ref = sys.modules[__name__] # Any module trying to import config will get the Config object instead sys.modules[__name__] = Config ================================================ FILE: mps_youtube/content.py ================================================ import math import copy import random from . import g, c, config from .util import getxy, fmt_time, uea_pad, yt_datetime, F try: import qrcode import io HAS_QRCODE = True except ImportError: HAS_QRCODE = False # In the future, this could support more advanced features class Content: pass class PaginatedContent(Content): def getPage(self, page): raise NotImplementedError def numPages(self): raise NotImplementedError class LineContent(PaginatedContent): def getPage(self, page): max_results = getxy().max_results s = page * max_results e = (page + 1) * max_results return self.get_text(s, e) def numPages(self): return math.ceil(self.get_count()/getxy().max_results) def get_text(self, s, e): raise NotImplementedError def get_count(self): raise NotImplementedError class StringContent(LineContent): def __init__(self, string): self._lines = string.splitlines() def get_text(self, s, e): return '\n'.join(self._lines[s:e]) def get_count(self): width = getxy().width count = sum(len(i) // width + 1 for i in self._lines) return count def page_msg(page=0): """ Format information about currently displayed page to a string. """ if isinstance(g.content, PaginatedContent): page_count = g.content.numPages() else: page_count = math.ceil(g.result_count/getxy().max_results) if page_count > 1: pagemsg = "{}{}/{}{}" #start_index = max_results * g.current_page return pagemsg.format('<' if page > 0 else '[', "%s%s%s" % (c.y, page+1, c.w), page_count, '>' if page + 1 < page_count else ']') return None def generate_songlist_display(song=False, zeromsg=None): """ Generate list of choices from a song list.""" # pylint: disable=R0914 if g.browse_mode == "ytpl": return generate_playlist_display() max_results = getxy().max_results if not g.model: g.message = zeromsg or "Enter /search-term to search or [h]elp" return logo(c.g) + "\n\n" g.rprompt = page_msg(g.current_page) have_meta = all(x.ytid in g.meta for x in g.model) user_columns = _get_user_columns() if have_meta else [] maxlength = max(x.length for x in g.model) lengthsize = 8 if maxlength > 35999 else 7 lengthsize = 6 if maxlength < 6000 else lengthsize reserved = 9 + lengthsize + len(user_columns) cw = getxy().width cw -= 1 title_size = cw - sum(1 + x['size'] for x in user_columns) - reserved before = [{"name": "idx", "size": 3, "heading": "Num"}, {"name": "title", "size": title_size, "heading": "Title"}] after = [{"name": "length", "size": lengthsize, "heading": "Length"}] columns = before + user_columns + after for n, column in enumerate(columns): column['idx'] = n column['sign'] = "-" if not column['name'] == "length" else "" fmt = ["%{}{}s ".format(x['sign'], x['size']) for x in columns] fmtrow = fmt[0:1] + ["%s "] + fmt[2:] fmt, fmtrow = "".join(fmt).strip(), "".join(fmtrow).strip() titles = tuple([x['heading'][:x['size']] for x in columns]) hrow = c.ul + fmt % titles + c.w out = "\n" + hrow + "\n" for n, x in enumerate(g.model[:max_results]): col = (c.r if n % 2 == 0 else c.p) if not song else c.b details = {'title': x.title, "length": fmt_time(x.length)} details = copy.copy(g.meta[x.ytid]) if have_meta else details otitle = details['title'] details['idx'] = "%2d" % (n + 1) details['title'] = uea_pad(columns[1]['size'], otitle) #cat = details.get('category') or '-' #details['category'] = 'pafy.get_categoryname(cat)' details['ytid'] = x.ytid line = '' for z in columns: fieldsize, field, direction = z['size'], z['name'], "<" if z['sign'] == "-" else ">" line += uea_pad(fieldsize, details[field], direction) if not columns[-1] == z: line += " " col = col if not song or song != g.model[n] else c.p line = col + line + c.w out += line + "\n" return out + "\n" * (5 - len(g.model)) if not song else out def generate_playlist_display(): """ Generate list of playlists. """ if not g.ytpls: g.message = c.r + "No playlists found!" return logo(c.g) + "\n\n" g.rprompt = page_msg(g.current_page) cw = getxy().width fmtrow = "%s%-5s %s %-12s %-8s %-2s%s\n" fmthd = "%s%-5s %-{}s %-12s %-9s %-5s%s\n".format(cw - 36) head = (c.ul, "Item", "Playlist", "Author", "Updated", "Count", c.w) out = "\n" + fmthd % head for n, x in enumerate(g.ytpls): col = (c.g if n % 2 == 0 else c.w) length = x.get('size') or "?" length = "%4s" % length title = x.get('title') or "unknown" author = x.get('author') or "unknown" updated = yt_datetime(x.get('updated'))[1] title = uea_pad(cw - 36, title) out += (fmtrow % (col, str(n + 1), title, author[:12], updated, str(length), c.w)) return out + "\n" * (5 - len(g.ytpls)) def _get_user_columns(): """ Get columns from user config, return dict. """ total_size = 0 user_columns = config.COLUMNS.get user_columns = user_columns.replace(",", " ").split() defaults = {"views": dict(name="viewCount", size=4, heading="View"), "rating": dict(name="rating", size=4, heading="Rtng"), "comments": dict(name="commentCount", size=4, heading="Comm"), "date": dict(name="uploaded", size=8, heading="Date"), "time": dict(name="uploadedTime", size=11, heading="Time"), "user": dict(name="uploaderName", size=10, heading="User"), "likes": dict(name="likes", size=4, heading="Like"), "dislikes": dict(name="dislikes", size=4, heading="Dslk"), "category": dict(name="category", size=8, heading="Category"), "ytid": dict(name="ytid", size=12, heading="Video ID")} ret = [] for column in user_columns: namesize = column.split(":") name = namesize[0] if name in defaults: z = defaults[name] nm, sz, hd = z['name'], z['size'], z['heading'] if len(namesize) == 2 and namesize[1].isdigit(): sz = int(namesize[1]) total_size += sz cw = getxy().width if total_size < cw - 18: ret.append(dict(name=nm, size=sz, heading=hd)) return ret def logo(col=None, version=""): """ Return text logo. """ col = col if col else random.choice((c.g, c.r, c.y, c.b, c.p, c.w)) logo_txt = r""" _ _ | | | | _ _ _____ _| |_ _ _| |__ ___ | | | |/ _ \ \ /\ / / __| | | | '_ \ / _ \ | |_| | __/\ V V /| |_| |_| | |_) | __/ \__, |\___| \_/\_/ \__|\__,_|_.__/ \___| __/ | |___/ """ version = " v" + version if version else "" logo_txt = col + logo_txt + c.w + version lines = logo_txt.split("\n") length = max(len(x) for x in lines) x, y, _ = getxy() indent = (x - length - 1) // 2 newlines = (y - 12) // 2 indent, newlines = (0 if x < 0 else x for x in (indent, newlines)) lines = [" " * indent + l for l in lines] logo_txt = "\n".join(lines) + "\n" * newlines return "" if g.debug_mode or g.no_textart else logo_txt def playlists_display(): """ Produce a list of all playlists. """ if not g.userpl: g.message = F("no playlists") return generate_songlist_display() if g.model else (logo(c.y) + "\n\n") maxname = max(len(a) for a in g.userpl) out = " {0}Local Playlists{1}\n".format(c.ul, c.w) start = " " fmt = "%s%s%-3s %-" + str(maxname + 3) + "s%s %s%-7s%s %-5s%s" head = (start, c.b, "ID", "Name", c.b, c.b, "Count", c.b, "Duration", c.w) out += "\n" + fmt % head + "\n\n" for v, z in enumerate(sorted(g.userpl)): n, p = z, g.userpl[z] l = fmt % (start, c.g, v + 1, n, c.w, c.y, str(len(p)), c.y, p.duration, c.w) + "\n" out += l return out def qrcode_display(url): if not HAS_QRCODE: return "(Install 'qrcode' to generate them)" qr = qrcode.QRCode() buf = io.StringIO() buf.isatty = lambda: True qr.add_data(url) qr.print_ascii(out=buf) return buf.getvalue() def get_last_query(): # Prevent crash if no last query if g.last_search_query == (None, None) or \ 'func' not in g.last_search_query[1]: g.content = logo() g.message = "No playlist loaded" return songs_list_or_func = g.last_search_query[1]['func'] if callable(songs_list_or_func): songs = songs_list_or_func(0,None) else: songs = songs_list_or_func return songs ================================================ FILE: mps_youtube/contentquery.py ================================================ """ ContentQuery is an abstraction layer between the the pafy.call_gdata and the listViews. It lets you treat A query as a list of all the results, even though data is only queried when requested. """ from . import util, pafy class ContentQuery: """ A wrapper for pafy.call_gdata. I lets you treat a search as a list, but the results will only be fetched when needed. """ maxresults = 0 pdata = [] nextpagetoken = None datatype = None query = None api = None def __init__(self, datatype, api, query): # Perform initial API call, setBoundaries # call parseData self.datatype = datatype self.query = query self.api = api self.pdata = [] self._perform_api_call() def __getitem__(self, iid): # Check if we already got the item or slice needed # Call and parse nextPage as long as you dont have the data # needed. last_id = iid.stop if iid.__class__ == slice else iid last_datapoint = min(last_id, self.maxresults) while len(self.pdata) < last_datapoint: self._perform_api_call() return self.pdata[iid] def count(self): """ Returns how many items are in the list """ return self.maxresults def __len__(self): return abs(self.count()) def _perform_api_call(self): # Include nextPageToken if it is set # qry = dict( # pageToken=self.nextpagetoken, # **(self.query) # ) if self.nextpagetoken else self.query # Run query util.dbg("CQ.query", self.query) data = pafy.channel_search(self.query)#pafy.call_gdata(self.api, qry) self.maxresults = len(data)#int(data.get("pageInfo").get("totalResults")) self.nextpagetoken = None#data.get("nextPageToken") for obj in data: self.pdata.append(self.datatype(obj)) ================================================ FILE: mps_youtube/description_parser.py ================================================ """ Module for trying to parse and retrieve song data from descriptions """ import re import random def calculate_certainty(line): """ Determine if a line contains a """ certainty_indexes = [ {'regex': r"(?:\(?(?:\d{0,4}:)?\d{0,2}:\d{0,2}\)?(?: - )?){1,2}", 'weight': 1}, {'regex': r"(([\w&()\[\]'\.\/ ]+)([ ]?[-]+[ ]?)([\w&()\[\]'\.\/ ]+))+", 'weight': 0.75}, {'regex': r"^([\d]+[. ]+)", 'weight': 1} ] certainty = 0.0 for method in certainty_indexes: if re.match(method['regex'], line): certainty += method['weight'] return certainty / len(certainty_indexes) def has_artist(text): """ Determine if the strìng has artist or not """ regex = r"(?:([\w&()\[\]'\.\/ ]+)(?:[ ]?[-]+[ ]?)([\w&()\[\]'\.\/ ]+))+" return not re.match(regex, text) def strip_string(text, single=False): """ Strip an artist-combo string """ # Removes timestamps ts_reg = r"(?:\(?(?:\d{0,4}:)?\d{1,2}:\d{1,2}\)?(?: - )?){1,2}" text = re.sub(ts_reg, "", text) # Removes Tracknumbers. text = re.sub(r"^([\d]+[. ]+)", "", text) # Removes starting with non words text = re.sub(r"^[^\w&()\[\]'\.\/]", "", text, flags=re.MULTILINE) artist, track = None, None if not single: rgex = r"(?:([\w&()\[\]'\.\/ ]+)(?:[ ]?[-]+[ ]?)([\w&()\[\]'\.\/ ]+))+" artist, track = (re.findall(rgex, text)[0]) else: track = text return artist, track def long_substr(data): """ https://stackoverflow.com/a/2894073 """ substr = '' if len(data) > 1 and len(data[0]) > 0: for i in range(len(data[0])): for j in range(len(data[0])-i+1): if j > len(substr) and is_substr(data[0][i:i+j], data): substr = data[0][i:i+j] return substr def is_substr(find, data): """ Check if is substring """ if len(data) < 1 and len(find) < 1: return False for i, _ in enumerate(data): if find not in data[i]: return False return True def artist_from_title(title): """ Try to determine an artist by doing a search on the video and try to find the most common element by n number of times looking for the most common substring in a subset of the results from youtube """ query = {} query['q'] = title query['type'] = 'video' query['fields'] = "items(snippet(title))" query['maxResults'] = 50 query['part'] = "snippet" results = None#pafy.call_gdata('search', query)['items'] titles = [x['snippet']['title'].upper() for x in results] alts = {} for _ in range(100): random.shuffle(titles) subset = titles[:10] string = long_substr(subset).strip() if len(string) > 3: alts[string] = alts.get(string, 0) + 1 best_string = None if len(alts) == 1: best_string = list(alts.keys())[0].capitalize() else: best_guess = 99999 best_string = None for key in list(alts.keys()): current_guess = title.upper().find(key) if current_guess < best_guess: best_guess = current_guess best_string = key.capitalize() best_string = re.sub(r"([^\w]+)$", "", best_string) best_string = re.sub(r"^([^\w]+)", "", best_string) return best_string def parse(text, title="Unknown"): """ Main function""" # Determine a certainty index for each line lines = [] for line in text.split('\n'): lines.append((calculate_certainty(line), line)) # Get average from all strings certainty_average = sum([x[0] for x in lines]) / len(lines) # Single out lines with above average certainty index lines = filter(lambda a: a is not None, [x if x[0] > certainty_average else None for x in lines]) # Determine if they are artist combo strings or only title cmbs = [] for line in lines: is_ac = has_artist(line[1]) cmbs.append(strip_string(line[1], is_ac)) # No or very few tracklists will ommit aritsts or add artist information # on only a few select number of tracks, therefore we count entries with # and without artist, and remove the anomalities IF the number of # anomalities are small enough counters = {'has': 0, 'not': 0} for combo in cmbs: counters['has' if combo[0] else 'not'] += 1 dominant = 'has' if counters['has'] > counters['not'] else 'not' diff = abs(counters['has'] - counters['not']) if diff > sum([counters['has'], counters['not']]): print("Too many anomalities detected") return [] if dominant == 'has': cmbs = filter(lambda a: a is not None, [x if x[0] is not None else None for x in cmbs]) else: arti = artist_from_title(title) cmbs = filter(lambda a: a is not None, [(arti, x[1]) if x[0] is None else None for x in cmbs]) return list(cmbs) ================================================ FILE: mps_youtube/g.py ================================================ """ Module for holding globals that are needed throught mps-youtube. """ import collections import os import sys from . import c, paths from .playlist import Playlist volume = None transcoder_path = "auto" delete_orig = True encoders = [] muxapp = False meta = {} artist = "" # Mostly used for scrobbling purposes album = "" # Mostly used for scrobbling purposes scrobble = False scrobble_queue = [] lastfm_network = None detectable_size = True command_line = False debug_mode = False preload_disabled = False ytpls = [] mpv_version = 0, 0, 0 mpv_options = None mpv_usesock = False mplayer_version = 0 mprisctl = None browse_mode = "normal" preloading = [] # expiry = 5 * 60 * 60 # 5 hours no_clear_screen = False no_textart = False max_retries = 3 max_cached_streams = 1500 username_query_cache = collections.OrderedDict() model = Playlist(name="model") last_search_query = (None, None) current_page = 0 result_count = 0 rprompt = None active = Playlist(name="active") userpl = {} userhist = {} pafs = collections.OrderedDict() streams = collections.OrderedDict() pafy_pls = {} # selected_pafy_pls_id = '' last_opened = message = content = "" suffix = "3" # Python 3 OLD_CFFILE = os.path.join(paths.get_config_dir(), "config") CFFILE = os.path.join(paths.get_config_dir(), "config.json") TCFILE = os.path.join(paths.get_config_dir(), "transcode") OLD_PLFILE = os.path.join(paths.get_config_dir(), "playlist" + suffix) PLFILE = os.path.join(paths.get_config_dir(), "playlist_v2") PLFOLDER = os.path.join(paths.get_config_dir(), "playlists") OLDHISTFILE = os.path.join(paths.get_config_dir(), "play_history") HISTFILE = os.path.join(paths.get_config_dir(), "play_history.m3u") CACHEFILE = os.path.join(paths.get_config_dir(), "cache_py_" + sys.version[0:5]) READLINE_FILE = None PLAYER_OBJ = None categories = { "film": 1, "autos": 2, "music": 10, "sports": 17, "travel": 19, "gaming": 20, "blogging": 21, "news": 25 } playerargs_defaults = { "mpv": { "msglevel": { "<0.4": "--msglevel=all=no:statusline=status", ">=0.4": "--msg-level=all=no,statusline=status", }, "title": "--force-media-title", "fs": "--fs", "novid": "--no-video", "ignidx": "--demuxer-lavf-o=fflags=+ignidx", "geo": "--geometry"}, "mplayer": { "title": "-title", "fs": "-fs", "novid": "-novideo", # "ignidx": "-lavfdopts o=fflags=+ignidx".split() "ignidx": "", "geo": "-geometry"}, "vlc": { "title": "--meta-title"} } argument_commands = [] commands = [] text = { "exitmsg": ("*yewtube - https://github.com/iamtalhaasghar/yewtube is a fork of\nmps-youtube - *https://github.com/mps-youtube/mps-youtube*" "\nReleased under the GPLv3 license\n" "(c) 2021 iamtalhaasghar\n(c) 2014, 2015 np1 and contributors*\n"""), "exitmsg_": (c.r, c.b, c.r, c.w), # Error / Warning messages 'no playlists': "*No saved playlists found!*", 'no playlists_': (c.r, c.w), 'pl bad name': '*&&* is not valid a valid name. Ensure it starts with' ' a letter or _', 'pl bad name_': (c.r, c.w), 'pl not found': 'Playlist *&&* unknown. Saved playlists are shown ' 'above', 'pl not found_': (c.r, c.w), 'pl not found advise ls': 'Playlist "*&&*" not found. Use *ls* to ' 'list', 'pl not found advise ls_': (c.y, c.w, c.g, c.w), 'pl empty': 'Playlist is empty!', 'advise add': 'Use *add N* to add a track', 'advise add_': (c.g, c.w), 'advise search': 'Search for items and then use *add* to add them', 'advise search_': (c.g, c.w), 'no data': 'Error fetching data. Possible network issue.' '\n*&&*', 'no data_': (c.r, c.w), 'use dot': 'Start your query with a *.* to perform a search', 'use dot_': (c.g, c.w), 'cant get track': 'Problem playing last item: *&&*', 'cant get track_': (c.r, c.w), 'track unresolved': 'Sorry, this track is not available', 'no player': '*&&* was not found on this system', 'no player_': (c.y, c.w), 'no pl match for rename': '*Couldn\'t find matching playlist to ' 'rename*', 'no pl match for rename_': (c.r, c.w), 'invalid range': "*Invalid item / range entered!*", 'invalid range_': (c.r, c.w), '-audio': "*Warning* - the filetype you selected (&&) has no audio!", '-audio_': (c.y, c.w), 'no mix': 'No mix is available for the selected video', 'mix only videos': 'Mixes are only available for videos', 'invalid item': '*Invalid item entered!*', 'duplicate tracks': '*Warning* - duplicate track(s) && added to ' 'playlist!', 'duplicate tracks_': (c.y, c.w), # Info messages.. 'select mux': ("Select [*&&*] to mux audio or [*Enter*] to download " "without audio\nThis feature is experimental!"), 'select mux_': (c.y, c.w, c.y, c.w), 'pl renamed': 'Playlist *&&* renamed to *&&*', 'pl renamed_': (c.y, c.w, c.y, c.w), 'pl saved': 'Playlist saved as *&&*. Use *ls* to list playlists', 'pl saved_': (c.y, c.w, c.g, c.w), 'pl loaded': 'Loaded playlist *&&* as current playlist', 'pl loaded_': (c.y, c.w), 'pl viewed': 'Showing playlist *&&*', 'pl viewed_': (c.y, c.w), 'pl help': 'Enter *open * to load a playlist', 'pl help_': (c.g, c.w), 'added to pl': '*&&* tracks added (*&&* total [*&&*]). Use *vp* to ' 'view', 'added to pl_': (c.y, c.w, c.y, c.w, c.y, c.w, c.g, c.w), 'added to saved pl': '*&&* tracks added to *&&* (*&&* total [*&&*])', 'added to saved pl_': (c.y, c.w, c.y, c.w, c.y, c.w, c.y, c.w), 'song move': 'Moved *&&* to position *&&*', 'song move_': (c.y, c.w, c.y, c.w), 'song sw': ("Switched item *&&* with *&&*"), 'song sw_': (c.y, c.w, c.y, c.w), 'current pl': "This is the current playlist. Use *save * to save" " it", 'current pl_': (c.g, c.w), 'help topic': (" Enter *help * for specific help:"), 'help topic_': (c.y, c.w), 'songs rm': '*&&* tracks removed &&', 'songs rm_': (c.y, c.w), 'mkp empty': "*&&* is either empty or doesn't exist", 'mkp empty_': (c.b, c.r), 'mkp parsed': "*&&* entries found in *&&*", 'mkp parsed_': (c.g, c.w, c.b, c.w), 'mkp finding': "Finding the best match for *&&* ...", 'mkp finding_': (c.y, c.w), 'mkp desc unknown': "Unknown tabletype, *do a new search*", 'mkp desc unknown_': (c.y, c.w), 'mkp desc which data': "Which *tracks* to include?", 'mkp desc which data_': (c.y, c.w), 'mkp no valid': "*No valid tracks found in that description*", 'mkp no valid_': (c.y, c.w)} ================================================ FILE: mps_youtube/helptext.py ================================================ """ Holds all help text """ import pathlib import re import socket from urllib.error import HTTPError, URLError from urllib.request import urlopen from . import c, g from .util import F, get_near_name def helptext(): """ Return a list of help categories, with their contents. """ return [ ("basic", "Basics", """ {0}Basic Usage{1} Use {2}/{1} or {2}.{1} to prefix your search query. e.g., {2}/pink floyd{1} Then, when results are shown: {2}{1} - play specified items, separated by commas. e.g., {2}1-3,5{1} plays items 1, 2, 3 and 5. {2}i {1} - view information on video {2}c {1} - view comments for video {2}d {1} - download video {2}r {1} - show videos related to video {2}u {1} - show videos uploaded by uploader of video {2}x {1} - copy item url to clipboard. (See the note below) Note: This feature requires `pyperclip` which is installed automatically when you install yewtube but Linux users further need to install `xsel` or `xclip` manually using apt, dnf, pacman, zypper or whatever package manager you use. Visit https://pyperclip.readthedocs.io/en/latest/index.html#not-implemented-error for more info. {2}q{1}, {2}quit{1} - exit yewtube """.format(c.ul, c.w, c.y)), ("search", "Searching and Retrieving", """ {0}Searching and Retrieving{1} {2}set search_music false{1} - search all YouTube categories. {2}set search_music true{1} - search only YouTube music category. {2}/{1} or {2}.{1} to search for videos. e.g., {2}/daft punk{1} Search Arguments: {2}-d, --duration{1} Can be any/short/medium/long {2}-a, --after{1} Date in {2}YYYY-MM-DD{1} or {2}YYYY-MM-DD{1}T{2}HH:MM{1} format {2}-l, --live{1} Limit search to livestreams {2}-c, --category{1} Search within a category, (number or string) Available categories: {2}{3}{1} {2}//{1} or {2}..{1} - search for YouTube playlists. e.g., \ {2}//80's music{1} {2}n{1} and {2}p{1} - continue search to next/previous pages. {2}p {1} - switch to page . {2}album {1} - Search for matching tracks using album title {2}channels {1} - Search for channels by channelname {2}live {1} - Search for livestreams from a range of categories. Categories: {2}{3}{1} {2}mkp {1} - Creates a playlist automatically with video titles from fullfilepath : Full path of text file with one title per line {2}mkp -d {1} - Create a playlist based on tracks listed in that videos description. (Alternatively one can use {2}--description{1}) {2}user {1} - list YouTube uploads by . {2}user /{1} - as above, but matches . {2}userpl {1} - list YouTube playlists created by . {2}pl {1} - Open YouTube playlist by url or id. {2}url {1} - Retrieve specific YouTube video by url or id. {2}url ... {1} - Retrieve specific YouTube videos by url or id. {2}url_file {1} - Retrieve YouTube videos by url or id from a .txt file. File format : .txt, with one url or id by line. {2}r {1} - show videos related to video . {2}u {1} - show videos uploaded by uploader of video . {2}c {1} - view comments for video """.format(c.ul, c.w, c.y, ", ".join(g.categories.keys()))), ("edit", "Editing / Manipulating Results", """ {0}Editing and Manipulating Results{1} {2}rm {1} - remove items from displayed results. {2}sw ,{1} - swap two items. {2}mv ,{1} - move item to position . {2}save {1} - save displayed items as a local playlist. {2}mix {1} - show YouTube mix playlist from item in results. {2}shuffle{1} - Shuffle the displayed results. {2}shuffle all{1} - Shuffle entire loaded playlist. {2}reverse{1} or {2}reverse -{1} - Reverse the displayed items or item range. {2}reverse all{1} - Reverse order of entire loaded playlist. """.format(c.ul, c.w, c.y)), ("download", "Downloading and Playback", """ {0}Downloading and Playback{1} {2}set show_video true{1} - play video instead of audio. {2}{1} - play specified items, separated by commas. e.g., {2}1-3,5{1} plays items 1, 2, 3 and 5 {2}d {1} - view downloads available for an item. {2}da {1} - download best available audio file(s). {2}dv {1} - download best available video file(s). {2}dapl {1} - download YouTube playlist (audio) by url or id. {2}dvpl {1} - download YouTube playlist (video) by url or id. {2}daupl {1} - download user's YouTube playlists (audio). {2}dvupl {1} - download user's YouTube playlists (video). {2}dlurl {1} - download a YouTube video by url or video id. {2}daurl {1} - download best available audio of YouTube video by url or video id. {2}playurl {1} - play a YouTube video by url or id. {2}browserplay {1} - open a specified previous search in browser. {2}all{1} or {2}*{1} - play all displayed items. {2}repeat {1} - play and repeat the specified items. {2}shuffle {1} - play specified items in random order. """.format(c.ul, c.w, c.y)), ("dl-command", "Downloading Using External Application", """ {0}Download Using A Custom Application{1} Use {2}set download_command {1} to specify a custom command to use for downloading. mps-youtube will make the following substitutions: %u - url of the remote file to download %d - download directory as set in DDIR in mps-youtube config %f - filename (determined by title and filetype) %F - full file path (%d/%f) %i - youtube video id for example, to download using aria2c (http://aria2.sourceforge.net), enter: {2}set download_command aria2c --dir=%d --out=%f %u{1} Note that using a custom download command does not support transcoding the downloaded file to another format using mps-youtube. """.format(c.ul, c.w, c.y)), ("encode", "Encoding to MP3 and other formats", """ {0}Encoding to MP3 and other formats{1} Enter {2}encoders{1} to view available encoding presets Enter {2}set encoder {1} to apply an encoding preset for downloads This feature requires that ffmpeg or avconv is installed on your system and is available in the system path. The encoding presets can be modified by editing the text config file which resides at: {3} """.format(c.ul, c.w, c.y, g.TCFILE)), ("playlists", "Using Local Playlists", """ {0}Using Local Playlists{1} {2}add {1} - add items to the current playlist. {2}add {1} - add items to the specified playlist. ( will be created if it doesn't already exist) {2}vp{1} - view current playlist. {2}ls{1} - list saved playlists. {2}mv {1} - rename a playlist. {2}rmp {1} - delete a playlist from disk. {2}open {1} - open a saved playlist as the current playlist. {2}play {1} - play a saved playlist directly. {2}view {1} - view a playlist (current playlist left intact). {2}save{1} or {2}save {1} - save the displayed items as a playlist. {2}rm {1} - remove items from displayed results. {2}sw ,{1} - swap two items. {2}mv ,{1} - move item to position . """.format(c.ul, c.w, c.y)), ("history", "Accessing Local History", """ {0}Accessing Local History{1} Access songs that have been played within yewtube {2}history{1} - displays a list of songs contained in history {2}history clear{1} - clears the song history {2}history recent{1} - displays a list of recent played songs {2}set history on|off{1} - toggles history recording """.format(c.ul, c.w, c.y)), ("invoke", "Invocation Parameters", """ {0}Invocation{1} All yewtube commands can be entered from the command line. For example; {2}yt dlurl {1} to download a YouTube video by url or id {2}yt playurl {1} to play a YouTube video by url or id {2}yt /mozart{1} to search {2}yt //best songs of 2010{1} for a playlist search {2}yt play {1} to play a saved playlist {2}yt ls{1} to list saved playlists For further automation, a series of commands can be entered separated by commas (,). E.g., {2}yt open 1, 2-4{1} - play items 2-4 of first saved playlist {2}yt //the doors, 1, all -a{1} - open YouTube playlist and play audio If you need to enter an actual comma on the command line, use {2},,{1} instead. """.format(c.ul, c.w, c.y)), ("config", "Configuration Options", """ {0}Configuration{1} {2}set{1} - view current configuration {2}set default{1} - set an item to its default value {2}set all default{1} - restore default settings {2}set checkupdate true|false{1} - check for updates on exit {2}set columns {1} - select extra displayed fields in search results: (valid: views comments rating date time user likes dislikes category ytid) {2}set ddir {1} - set where downloads are saved {2}set download_command {1} - type {2}help dl-command{1} for info {2}set encoder {1} - set encoding preset for downloaded files {2}set fullscreen true|false{1} - output video content in full-screen mode {2}set always_repeat true|false{1} - always in repeat mode without repeat {2}set max_res {1} - play / download maximum video resolution height{3} {2}set notifier {1} - call with each new song title {2}set order {1} search result ordering {2}set user_order <|relevance|date|views|rating>{1} user upload list result ordering, leave blank for the same as order setting {2}set overwrite true|false{1} - overwrite existing files (skip if false) {2}set player {1} - use for playback {2}set playerargs {1} - use specified arguments with player {2}set lookup_metadata true|false{1} - lookup metadata using Last.fm {2}set lastfm_username {1} - scrobble to this Last.fm userprofile {2}set lastfm_password {1} - Last.fm password (saved in hash form) {2}set lastfm_api {1} - API key needed for Last.fm mps-yt authorization {2}set lastfm_secret {1} - secret for the Last.fm API key {2}set search_music true|false{1} - search only music (all categories if false) {2}set show_mplayer_keys true|false{1} - show keyboard help for mplayer and mpv {2}set show_status true|false{1} - show status messages and progress {2}set show_video true|false{1} - show video output (audio only if false) {2}set window_pos -{1} - set player window position {2}set window_size x{1} - set player window width & height {2}set audio_format {1} - set default music audio format {2}set video_format {1} - set default music video format {2}set set_title true|false{1} - change window title {2}set show_qrcode true|false{1} - show qrcode of the URL in the video information panel {2}set history true|false{1} - record play history {2}set input_history true|false{1} - record command input history {2}set vlc_dummy_interface true|false{1} - whether to hide VLC GUI or not (hides when true) Additionally, {2}set -t{1} may be used to temporarily change a setting without saving it to disk """.format(c.ul, c.w, c.y, '\n{0}set max_results {1} - show re' 'sults when searching (max 50)'.format(c.y, c.w) if not g.detectable_size else '')), ("lastfm", "Last.fm configuration", """ {0}Configure Last.fm{1} pylast needs to be installed for Last.fm support. See https://github.com/pylast/pylast. Use {2}set{1} to set your Last.fm login credenditals, e.g. {2}set lastfm_username jane_doe{1}. Similarly, you also have to provide an API key and it's corresponding secret. An API key can be retrieved from https://www.last.fm/api/account/create. Your Last.fm configuration is saved and automatically reloaded when mps-youtube starts. After having set the required information, a connection can also be established with {2}lastfm_connect{1}. Additionally, {2}lastfm_connect{1} provides verbose error messages. For now, Last.fm support only works with the {2}album{1} command. """.format(c.ul, c.w, c.y)), ("tips", "Advanced Tips", """ {0}Advanced Tips{1} Use {2}-w{1}, {2}-f{1} or {2}-a{1} with your choice to override the configured\ setting and play items in windowed, fullscreen or audio modes. E.g., 1-4 -a When specifying columns with {2}set columns{1} command, append :N to set\ width. E.g.: {2}set columns date views user:17 likes{1} When using {2}open{1}, {2}view{1} or {2}play{1} to access a local playlist, \ you can enter the first few characters instead of the whole name. Use {2}5-{1} to select items 5 upward and {2}-5{1} to select up to item 5. \ This can be included with other choices. e.g., 5,3,7-,-2 You can use spaces instead of commas: 5 3 7- -2 Reversed ranges also work. eg., 5-2 {2}dump{1} - to show entire contents of an opened YouTube playlist. (useful for playing or saving entire playlists, use {2}undump{1} to \ undo) {2}set player mpv{1} or {2}set player mplayer{1} - change player application Use {2}1{1} and {2}0{1} in place of true and false when using the {2}set{1} \ command Use {2}clearcache{1} command to clear the cache. """.format( c.ul, c.w, c.y ), ), ( "new", "Check if new version is available", """{0}What's New{1}\n{3}""".format(c.ul, c.w, c.y, "get_changelog()"), ), ( "changelog", "Check program changelog", """{0}Changelog{1}\n{3}""".format(c.ul, c.w, c.y, "get_changelog_local()"), ), ( "tor", "Check Tor Status. NOTE: Use this feature at your own risk. In case of any kind of damage we will not be responsible.", """{0}Tor Status{1}\n{3}""".format(c.ul, c.w, c.y, "check_tor()"), ), ] def get_help(choice): """ Return help message. """ helps = {"download": ("playback dl listen watch show repeat playing" "show_video playurl browserplay dlurl d da dv all *" " play browsersearch".split()), "dl-command": ("dlcmd dl-cmd download-cmd dl_cmd download_cmd " "download-command download_command".split()), "encode": ("encoding transcoding transcode wma mp3 format " "encode encoder".split()), "invoke": "command commands yt invocation".split(), "search": ("user userpl pl pls r n p url album " "editing result results related remove swop mkp --description".split()), "edit": ("editing manupulate manipulating rm mv sw edit move " "swap shuffle".split()), "tips": ("undump dump -f -w -a adv advanced".split(" ")), "basic": ("basic comment basics c copy clipboard comments u " "i".split()), "config": ("set checkupdate colours colors ddir directory player " "arguments args playerargs music search_music keys " "status show_status show_video video configuration " "fullscreen full screen folder player mpv mplayer" " settings default reset configure audio results " "max_results size lines rows height window " "position window_pos quality resolution max_res " "columns width console overwrite".split()), "playlists": ("save rename delete move rm ls mv sw add vp open" " view".split())} for topic, aliases in helps.items(): if choice in aliases: choice = topic break choice = "menu" if not choice else choice out, all_help = "", helptext() help_names = [x[0] for x in all_help] choice = get_near_name(choice, help_names) def indent(x): """ Indent. """ return "\n ".join(x.split("\n")) if choice == "menu" or choice not in help_names: out += " %sHelp Topics%s" % (c.ul, c.w) out += F('help topic', 2, 1) for x in all_help: out += ("\n%s %-10s%s : %s" % (c.y, x[0], c.w, x[1])) out += "\n" return out else: if choice == 'tor': output_text = check_tor() elif choice == 'new': output_text = get_changelog() elif choice == "changelog": output_text = get_changelog_local() else: choice = help_names.index(choice) output_text = all_help[choice][2] return indent(output_text) def get_changelog(): try: url = "https://raw.githubusercontent.com/iamtalhaasghar/yewtube/master/CHANGELOG.md" v = urlopen(url, timeout=1).read().decode() v = v.split('## v')[1] return v except (URLError, HTTPError, socket.timeout): return "read changelog timed out" def get_changelog_local(): cl_path = pathlib.Path(__file__).parent.parent / "CHANGELOG.md" if cl_path.is_file(): return "\n".join(reversed(cl_path.read_text().splitlines())) else: return "can't find changelog file" def check_tor(): try: url = "https://check.torproject.org/?lang=en" v = urlopen(url, timeout=1).read().decode() ip = re.findall('(.*)', v) status = re.findall('Congratulations.(.*)', v) if len(status) == 0: status = re.findall('Sorry.(.*)', v) return str({'ip' : ip, 'status': status[0]}) except (URLError, HTTPError, socket.timeout): return "read check tor status timed out" ================================================ FILE: mps_youtube/history.py ================================================ import os import pickle from . import g, c from .util import dbg from .playlist import Playlist from .playlists import read_m3u def add(song): """ Add song to history. """ if not g.userhist.get('history'): g.userhist['history'] = Playlist('history') g.userhist['history'].songs.append(song) save() def load(): """ Open history. Called once on script invocation. """ _convert_to_m3u() try: g.userhist['history'] = read_m3u(g.HISTFILE) except FileNotFoundError: # no playlist found, create a blank one if not os.path.isfile(g.HISTFILE): g.userhist = {} save() def save(): """ Save history. Called each time history is updated. """ with open(g.HISTFILE, 'w') as hf: hf.write('#EXTM3U\n\n') if 'history' in g.userhist: for song in g.userhist['history'].songs: hf.write('#EXTINF:%d,%s\n' % (song.length, song.title)) hf.write('https://www.youtube.com/watch?v=%s\n' % song.ytid) dbg(c.r + "History saved\n---" + c.w) def _convert_to_m3u(): """ Converts the play_history file to the m3u format. """ # Skip if m3u file already exists if os.path.isfile(g.HISTFILE): return elif not os.path.isfile(g.OLDHISTFILE): return with open(g.OLDHISTFILE, "rb") as hf: g.userhist = pickle.load(hf) save() ================================================ FILE: mps_youtube/init.py ================================================ import argparse import logging import multiprocessing import os import platform import re import sys import tempfile try: # pylint: disable=F0401 import colorama has_colorama = True except ImportError: has_colorama = False try: import readline readline.set_history_length(2000) has_readline = True except ImportError: has_readline = False from . import __version__, c, cache, config, g, paths, screen from .helptext import helptext from .util import assign_player, dbg, has_exefile, load_player_info, xprint mswin = os.name == "nt" def init(): """ Initial setup. """ _process_cl_args() # set player to mpv or mplayer if found, otherwise unset suffix = ".exe" if mswin else "" vlc, mplayer, mpv = "vlc" + suffix, "mplayer" + suffix, "mpv" + suffix # check for old pickled binary config and convert to json if so config.convert_old_cf_to_json() if not os.path.exists(g.CFFILE): if has_exefile(vlc): config.PLAYER.set(vlc) elif has_exefile(mpv): config.PLAYER.set(mpv) elif has_exefile(mplayer): config.PLAYER.set(mplayer) config.save() else: config.load() try: assign_player(config.PLAYER.get) # Player is not assigned when config is loaded except Exception as ex: g.message = "%sFailed to get %s`s version. Probabily it is not installed. Try installing it again or change player using `set player ` %s" %(c.y, config.PLAYER.get , c.w) screen.update() input("Press Enter to go back to main menu.") # Make pafy use the same api key # pafy.set_api_key(config.API_KEY.get) _init_readline() cache.load() _init_transcode() # ensure encoder is not set beyond range of available presets if config.ENCODER.get >= len(g.encoders): config.ENCODER.set("0") # check mpv/mplayer version if has_exefile(config.PLAYER.get): load_player_info(config.PLAYER.get) # setup colorama if has_colorama and mswin: # Colorama converts ansi escape codes to Windows system calls colorama.init() # find muxer app if mswin: g.muxapp = has_exefile("ffmpeg.exe") or has_exefile("avconv.exe") else: g.muxapp = has_exefile("ffmpeg") or has_exefile("avconv") # initialize MPRIS2 interface if config.MPRIS.get: try: from . import mpris conn1, conn2 = multiprocessing.Pipe() g.mprisctl = mpris.MprisConnection(conn1) t = multiprocessing.Process(target=mpris.main, args=(conn2,)) t.daemon = True t.start() except ImportError: print("could not load MPRIS interface. missing libraries.") def _init_transcode(): """ Create transcoding presets if not present. Read transcoding presets. """ if not os.path.exists(g.TCFILE): config_file_contents = """\ # transcoding presets for mps-youtube # VERSION 0 # change ENCODER_PATH to the path of ffmpeg / avconv or leave it as auto # to let mps-youtube attempt to find ffmpeg or avconv ENCODER_PATH: auto # Delete original file after encoding it # Set to False to keep the original downloaded file DELETE_ORIGINAL: True # ENCODING PRESETS # Encode ogg or m4a to mp3 256k name: MP3 256k extension: mp3 valid for: ogg,m4a,webm command: ENCODER_PATH -i IN -codec:a libmp3lame -b:a 256k OUT.EXT # Encode ogg or m4a to mp3 192k name: MP3 192k extension: mp3 valid for: ogg,m4a,webm command: ENCODER_PATH -i IN -codec:a libmp3lame -b:a 192k OUT.EXT # Encode ogg or m4a to mp3 highest quality vbr name: MP3 VBR best extension: mp3 valid for: ogg,m4a,webm command: ENCODER_PATH -i IN -codec:a libmp3lame -q:a 0 OUT.EXT # Encode ogg or m4a to mp3 high quality vbr name: MP3 VBR good extension: mp3 valid for: ogg,m4a,webm command: ENCODER_PATH -i IN -codec:a libmp3lame -q:a 2 OUT.EXT # Encode m4a to ogg name: OGG 256k extension: ogg valid for: m4a command: ENCODER_PATH -i IN -codec:a libvorbis -b:a 256k OUT.EXT # Encode ogg to m4a name: M4A 256k extension: m4a valid for: ogg command: ENCODER_PATH -i IN -strict experimental -codec:a aac -b:a 256k OUT.EXT # Encode ogg or m4a to wma v2 name: Windows Media Audio v2 extension: wma valid for: ogg,m4a command: ENCODER_PATH -i IN -codec:a wmav2 -q:a 0 OUT.EXT""" with open(g.TCFILE, "w") as tcf: tcf.write(config_file_contents) dbg("generated transcoding config file") else: dbg("transcoding config file exists") with open(g.TCFILE, "r") as tcf: g.encoders = [dict(name="None", ext="COPY", valid="*")] e = {} for line in tcf.readlines(): if line.startswith("TRANSCODER_PATH:"): m = re.match("TRANSCODER_PATH:(.*)", line).group(1) g.transcoder_path = m.strip() elif line.startswith("DELETE_ORIGINAL:"): m = re.match("DELETE_ORIGINAL:(.*)", line).group(1) do = m.strip().lower() in ("true", "yes", "enabled", "on") g.delete_orig = do elif line.startswith("name:"): e['name'] = re.match("name:(.*)", line).group(1).strip() elif line.startswith("extension:"): e['ext'] = re.match("extension:(.*)", line).group(1).strip() elif line.startswith("valid for:"): e['valid'] = re.match("valid for:(.*)", line).group(1).strip() elif line.startswith("command:"): e['command'] = re.match("command:(.*)", line).group(1).strip() if "name" in e and "ext" in e and "valid" in e: g.encoders.append(e) e = {} def _init_readline(): """ Enable readline for input history. """ if g.command_line: return if has_readline: g.READLINE_FILE = os.path.join(paths.get_config_dir(), "input_history") if os.path.exists(g.READLINE_FILE): readline.read_history_file(g.READLINE_FILE) dbg(c.g + "Read history file" + c.w) def _process_cl_args(): """ Process command line arguments. """ parser = argparse.ArgumentParser(add_help=False) parser.add_argument('commands', nargs='*') parser.add_argument('--help', '-h', action='store_true') parser.add_argument('--version', '-v', action='store_true') parser.add_argument('--debug', '-d', action='store_true') parser.add_argument('--logging', '-l', action='store_true') parser.add_argument('--no-autosize', action='store_true') parser.add_argument('--no-preload', action='store_true') parser.add_argument('--no-textart', action='store_true') args = parser.parse_args() if args.version: screen.msgexit(_get_version_info()) elif args.help: screen.msgexit('\n'.join(i[2] for i in helptext())) if args.debug or os.environ.get("mpsytdebug") == "1": xprint(_get_version_info()) g.debug_mode = True g.no_clear_screen = True if args.logging or os.environ.get("mpsytlog") == "1" or g.debug_mode: logfile = os.path.join(tempfile.gettempdir(), "mpsyt.log") logging.basicConfig(level=logging.DEBUG, filename=logfile) logging.getLogger("pafy").setLevel(logging.DEBUG) if args.no_autosize: g.detectable_size = False g.command_line = "playurl" in args.commands or "dlurl" in args.commands if g.command_line: g.no_clear_screen = True if args.no_preload: g.preload_disabled = True if args.no_textart: g.no_textart = True g.argument_commands = args.commands def _get_version_info(): """ Return version and platform info. """ # pafy_version = pafy.__version__ # youtube_dl_version = None # if tuple(map(int, pafy_version.split('.'))) >= (0, 5, 0): # pafy_version += " (" + pafy.backend + " backend)" # if pafy.backend == "youtube-dl": from yt_dlp.version import __version__ as ytdlp_version dbus_version = None glib = False try: import dbus dbus_version = dbus.__version__ except Exception: pass try: from gi.repository import GLib glib = True except Exception: pass out = "yewtube version : " + __version__ out += "\nyt_dlp version : " + ytdlp_version out += "\nPython version : " + sys.version out += "\nProcessor : " + platform.processor() out += "\nMachine type : " + platform.machine() out += "\nArchitecture : %s, %s" % platform.architecture() out += "\nPlatform : " + platform.platform() out += "\nsys.stdout.enc : " + sys.stdout.encoding out += "\ndefault enc : " + sys.getdefaultencoding() out += "\nConfig dir : " + paths.get_config_dir() out += "\ndbus : " + str(dbus_version) out += "\nglib : " + str(glib) for env in "TERM SHELL LANG LANGUAGE".split(): value = os.environ.get(env) out += "\nenv:%-15s: %s" % (env, value) if value else "" return out ================================================ FILE: mps_youtube/listview/__init__.py ================================================ """ DOCSTING COMES HERE """ import re import math from .. import c, g, util, content from .base import ListViewItem from .user import ListUser from .livestream import ListLiveStream from .songtitle import ListSongtitle class ListView(content.PaginatedContent): """ Content Agnostic Numbered List This class, using ListViewItems as abstractions you can give it a list of data and which columns to show and it will show it. Todo: Currently we rely on the commands/play code to send information about which elements are being picked. Attributes: func The function that will be run on the selected items objects List of objects(or a ContentQuery object) columns A list of Hashes containing information about which columns to show page Current Page Column format: {"name": "idx", "size": 3, "heading": "Num"} name: The method name that will be called from the ListViewItem size: How much size is allocated to the columns, see ListView.content for more information about the dynamic options heading: The text shown in the header "idx" is generated in the content function, not by the ListViewItem """ func = None objects = None columns = None page = 0 def __init__(self, columns, objects, function_call=None): """ """ self.func = function_call self.objects = objects self.columns = columns self.object_type = None # Ensure single type of object types = len(set([obj.__class__ for obj in objects])) if types == 0: raise BaseException("No objects in list") if types > 1: raise BaseException("More than one kind of objects in list") self.object_type = [obj.__class__ for obj in objects][0] def numPages(self): """ Returns # of pages """ return max(1, math.ceil(len(self.objects) / self.views_per_page())) def getPage(self, page): self.page = page return self.content() def _page_slice(self): chgt = self.views_per_page() return slice(self.page * chgt, (self.page+1) * chgt) def content(self): """ Generates content =============== Dynamic fields =============== Column.size may instead of an integer be a string containing either "length" or "remaining". Length is for time formats like 20:40 Remaining will allocate all remaining space to that column. TODO: Make it so set columns can set "remaining" ? """ # Sums all ints, deal with strings later remaining = (util.getxy().width) - sum(1 + (x['size'] if x['size'] and x['size'].__class__ == int else 0) for x in self.columns) - (len(self.columns)) lengthsize = 0 if "length" in [x['size'] for x in self.columns]: max_l = max((getattr(x, "length")() for x in self.objects)) lengthsize = 8 if max_l > 35999 else 7 lengthsize = 6 if max_l < 6000 else lengthsize for col in self.columns: if col['size'] == "remaining": col['size'] = remaining - lengthsize if col['size'] == "length": col['size'] = lengthsize for num, column in enumerate(self.columns): column['idx'] = num column['sign'] = "-" if not column['name'] == "length" else "" fmt = ["%{}{}s ".format(x['sign'], x['size']) for x in self.columns] fmtrow = fmt[0:1] + ["%s "] + fmt[2:] fmt, fmtrow = "".join(fmt).strip(), "".join(fmtrow).strip() titles = tuple([x['heading'][:x['size']] for x in self.columns]) out = "\n" + (c.ul + fmt % titles + c.w) + "\n" for num, obj in enumerate(self.objects[self._page_slice()]): col = (c.r if num % 2 == 0 else c.p) idx = num + (self.views_per_page() * self.page) + 1 line = '' for column in self.columns: fieldsize, field = column['size'], column['name'] direction = "<" if column['sign'] == "-" else ">" if field == "idx": field = "%2d" % idx else: field = getattr(obj, field)(fieldsize) field = str(field) if field.__class__ != str else field line += util.uea_pad(fieldsize, field, direction) if column != self.columns[-1]: line += " " line = col + line + c.w out += line + "\n" return out def _play(self, _, choice, __): # pre, choice, post """ Handles what happends when a user selects something from the list Currently this functions hooks into commands/play """ uids = [] for splitted_choice in choice.split(","): cho = splitted_choice.strip() if cho.isdigit(): uids.append(int(cho) - 1) else: cho = cho.split("-") if cho[0].isdigit() and cho[1].isdigit(): uids += list(range(int(cho[0]) - 1, int(cho[1]))) var = getattr(self.object_type, "return_field")() self.func([getattr(self.objects[x], var)() for x in uids]) def views_per_page(self): """ Determines how many views can be per page """ return util.getxy().max_results ================================================ FILE: mps_youtube/listview/base.py ================================================ class ListViewItem: """ Base class for items Used by Listview """ data = None def __init__(self, data): self.data = data def __getattr__(self, key): return self.data[key] if key in self.data.keys() else None def length(self, _=0): """ Returns length of ListViewItem A LVI has to return something for length even if the item does not have one. """ return 0 ================================================ FILE: mps_youtube/listview/livestream.py ================================================ from .base import ListViewItem from .. import util class ListLiveStream(ListViewItem): """ Class exposing necessary components of a live stream """ # pylint: disable=unused-argument def ytid(self, lngt=10): """ Exposes ytid(string) """ return self.data.get("id").get("videoId") def ret(self): """ Returns content.video compatible tuple """ return (self.ytid(), self.title(), self.length()) def title(self, lngt=10): """ exposes title """ return util.uea_pad(lngt, self.data.get("snippet").get("title")) def description(self, lngt=10): """ exposes description """ return util.uea_pad(lngt, self.data.get("snippet").get("description")) @staticmethod def return_field(): """ ret """ return "ret" ================================================ FILE: mps_youtube/listview/songtitle.py ================================================ from .base import ListViewItem from .. import util as u class ListSongtitle(ListViewItem): """ Describes a user """ # pylint: disable=unused-argument _checked = False _certainty = 1.0 def __init__(self, data, certainty=1.0): self._checked = True self._certainty = certainty super(ListSongtitle, self).__init__(data) def artist(self, l=10): """ Get artist """ return u.uea_pad(l, self.data[0]) def title(self, l=10): """ Get title """ return u.uea_pad(l, self.data[1]) def checked(self, l=10): """ String from for checked """ return " X " if self._checked else " " def certainty(self): """ Float """ return self._certainty def is_checked(self): """ Returns true if checked """ return self._checked def toggle(self): """ Toggle checked status """ self._checked = not self._checked def ret(self): """ Used in the ListView play function """ return "%s - %s" % (self.artist().strip(), self.title().strip()) @staticmethod def return_field(): """ Determines which function will be called on selected items """ return "ret" ================================================ FILE: mps_youtube/listview/user.py ================================================ from .base import ListViewItem from .. import util as u class ListUser(ListViewItem): """ Describes a user """ # pylint: disable=unused-argument def id(self, length=0): """ Returns YTID """ return self.data.get("id") def name(self, length=10): """ Returns channel name """ return u.uea_pad(length, self.data.get("title")) def description(self, length=10): """ Channel description""" return u.uea_pad(length, self.data["descriptionSnippet"][0]['text'] if self.data['descriptionSnippet'] is not None else 'No description found') def kind(self, length=10): """ Returns the youtube datatype Example: youtube#channel, youtube#video """ return self.data.get("type") def ret(self): """ Used in the ListView play function """ return (self.name(), self.id(), "") @staticmethod def return_field(): """ Determines which function will be called on selected items """ return "ret" ================================================ FILE: mps_youtube/main.py ================================================ """ mps-youtube. https://github.com/np1/mps-youtube Copyright (C) 2014, 2015 np1 and contributors This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see . """ import locale import logging import os import sys import traceback as traceback_py from . import util completer = None try: import readline readline.set_history_length(2000) has_readline = True completer = util.CommandCompleter() readline.parse_and_bind('tab: complete') readline.set_completer(completer.complete_command) readline.set_completer_delims('') except ImportError: has_readline = False from . import g, c, commands, screen, history, init from . import __version__, playlists, content, listview from . import config mswin = os.name == "nt" try: locale.setlocale(locale.LC_ALL, "") # for date formatting except Exception as err: logging.debug(f"locale not set: {err}") def matchfunction(func, regex, userinput): """ Match userinput against regex. Call func, return True if matches. """ # Not supported in python 3.3 or lower # match = regex.fullmatch(userinput) # if match: match = regex.match(userinput) if match and match.group(0) == userinput: matches = match.groups() util.dbg("input: %s", userinput) util.dbg("function call: %s", func.__name__) util.dbg("regx matches: %s", matches) try: func(*matches) except IndexError: if g.debug_mode: g.content = ''.join(traceback_py.format_exception( *sys.exc_info())) g.message = util.F('invalid range') g.content = g.content or content.generate_songlist_display() except (ValueError, IOError) as e: if g.debug_mode: g.content = ''.join(traceback_py.format_exception( *sys.exc_info())) g.message = util.F('cant get track') % str(e) g.content = g.content or\ content.generate_songlist_display(zeromsg=g.message) except Exception as e:#pafy.GdataError as e: import traceback traceback.print_exception(type(e), e, e.__traceback__) if g.debug_mode: g.content = ''.join(traceback.format_exception( *sys.exc_info())) g.message = util.F('no data') % e g.content = g.content return True def prompt_for_exit(): """ Ask for exit confirmation. """ g.message = c.r + "Press ctrl-c again to exit" + c.w g.content = content.generate_songlist_display() screen.update() try: userinput = input(c.r + " > " + c.w) except (KeyboardInterrupt, EOFError): commands.misc.quits(showlogo=False) return userinput def main(): init.init() """ Main control loop. """ if config.SET_TITLE.get: util.set_window_title("yewtube") if not g.command_line: g.content = content.logo(col=c.g, version=__version__) + "\n\n" g.message = "Enter /search-term to search or [h]elp" screen.update() # open playlists from file playlists.load() # open history from file history.load() # setup scrobbling commands.lastfm.init_network(verbose=False) prev_model = [] scrobble_funcs = [commands.album_search.search_album] arg_inp = " ".join(g.argument_commands) prompt = "> " arg_inp = arg_inp.replace(r",,", "[mpsyt-comma]") arg_inp = arg_inp.split(",") while True: next_inp = "" if len(arg_inp): next_inp = arg_inp.pop(0).strip() next_inp = next_inp.replace("[mpsyt-comma]", ",") try: userinput = next_inp or input(prompt).strip() except (KeyboardInterrupt, EOFError): userinput = prompt_for_exit() for i in g.commands: if matchfunction(i.function, i.regex, userinput): if prev_model != g.model and not i.function in scrobble_funcs: g.scrobble = False prev_model = g.model break else: g.content = g.content or content.generate_songlist_display() if g.command_line: g.content = "" if userinput and not g.command_line: g.message = c.b + "Bad syntax. Enter h for help" + c.w elif userinput and g.command_line: sys.exit("Bad syntax") screen.update() ================================================ FILE: mps_youtube/mpris.py ================================================ """ mps-youtube. https://github.com/np1/mps-youtube Copyright (C) 2014 nagev This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see . """ import copy import json import os import re import socket import time import typing as T from threading import Thread import dbus import dbus.service from dbus.mainloop.glib import DBusGMainLoop IDENTITY = 'mps-youtube' BUS_NAME = 'org.mpris.MediaPlayer2.' + IDENTITY + '.instance' + str(os.getpid()) ROOT_INTERFACE = 'org.mpris.MediaPlayer2' PLAYER_INTERFACE = 'org.mpris.MediaPlayer2.Player' PROPERTIES_INTERFACE = 'org.freedesktop.DBus.Properties' MPRIS_PATH = '/org/mpris/MediaPlayer2' class Mpris2Controller: """ Controller for various MPRIS objects. """ def __init__(self): """ Constructs an MPRIS controller. Note, you must call acquire() """ # Do not import in main process to prevent conflict with pyperclip # (https://github.com/mps-youtube/mps-youtube/issues/461) from gi.repository import GLib self.mpris = None self.bus = None self.main_loop = GLib.MainLoop() def release(self): """ Releases all objects from D-Bus and unregisters the bus """ if self.mpris is not None: self.mpris.remove_from_connection() self.mpris = None if self.bus is not None: self.bus.get_bus().release_name(self.bus.get_name()) def acquire(self): """ Connects to D-Bus and registers all components """ self._acquire_bus() self._add_interfaces() def run(self, connection): """ Runs main loop, processing all calls binds on connection (Pipe) and listens player changes """ t = Thread(target=self._run_main_loop) t.daemon = True t.start() self.listenstatus(connection) def listenstatus(self, conn): """ Notifies interfaces that player connection changed """ while True: try: data = conn.recv() if isinstance(data, tuple): name, val = data if name == 'socket': Thread(target=self.mpris.bindmpv, args=(val,)).start() elif name == 'mplayer-fifo': self.mpris.bindfifo(val) elif name == 'mpv-fifo': self.mpris.bindfifo(val, mpv=True) else: self.mpris.setproperty(name, val) except IOError: break except KeyboardInterrupt: pass def _acquire_bus(self): """ Connect to D-Bus and set self.bus to be a valid connection """ if self.bus is not None: self.bus.get_bus().request_name(BUS_NAME) else: self.bus = dbus.service.BusName(BUS_NAME, bus=dbus.SessionBus(mainloop=DBusGMainLoop())) def _add_interfaces(self): """ Connects all interfaces to D-Bus """ self.mpris = Mpris2MediaPlayer(self.bus) def _run_main_loop(self): """ Runs glib main loop, ignoring keyboard interrupts """ while True: try: self.main_loop.run() except KeyboardInterrupt: pass class Mpris2MediaPlayer(dbus.service.Object): """ main dbus object for MPRIS2 implementing interfaces: org.mpris.MediaPlayer2 org.mpris.MediaPlayer2.Player """ def __init__(self, bus): """ initializes mpris object on dbus """ dbus.service.Object.__init__(self, bus, MPRIS_PATH) self.socket = None self.fifo = None self.mpv = False self.properties = { ROOT_INTERFACE : { 'read_only' : { 'CanQuit' : False, 'CanSetFullscreen' : False, 'CanRaise' : False, 'HasTrackList' : False, 'Identity' : IDENTITY, 'DesktopEntry' : 'mps-youtube', 'SupportedUriSchemes' : dbus.Array([], 's', 1), 'SupportedMimeTypes' : dbus.Array([], 's', 1), }, 'read_write' : { 'Fullscreen' : False, }, }, PLAYER_INTERFACE : { 'read_only' : { 'PlaybackStatus' : 'Stopped', 'Metadata' : { 'mpris:trackid' : dbus.ObjectPath( '/CurrentPlaylist/UnknownTrack', variant_level=1) }, 'Position' : dbus.Int64(0), 'MinimumRate' : 1.0, 'MaximumRate' : 1.0, 'CanGoNext' : True, 'CanGoPrevious' : True, 'CanPlay' : True, 'CanPause' : True, 'CanSeek' : True, 'CanControl' : True, }, 'read_write' : { 'Rate' : 1.0, 'Volume' : 1.0, }, }, } def bindmpv(self, sockpath): """ init JSON IPC for new versions of mpv >= 0.7 """ self.mpv = True self.socket = socket.socket(socket.AF_UNIX) # wait on socket initialization tries = 0 while tries < 10: time.sleep(.5) try: self.socket.connect(sockpath) break except socket.error: pass tries += 1 else: return try: observe_full = False self._sendcommand(["observe_property", 1, "time-pos"]) for line in self.socket.makefile(): resp = json.loads(line) # deals with bug in mpv 0.7 - 0.7.3 if resp.get('event') == 'property-change' and not observe_full: self._sendcommand(["observe_property", 2, "volume"]) self._sendcommand(["observe_property", 3, "pause"]) self._sendcommand(["observe_property", 4, "seeking"]) observe_full = True if resp.get('event') == 'property-change': self.setproperty(resp['name'], resp.get('data')) except socket.error: self.socket = None self.mpv = False def bindfifo(self, fifopath, mpv=False): """ init command fifo for mplayer and old versions of mpv """ time.sleep(1) # give it some time so fifo could be properly created try: self.fifo = open(fifopath, 'w') self._sendcommand(['get_property', 'volume']) self.mpv = mpv except IOError: self.fifo = None def setproperty(self, name: str, val: T.Optional[T.Any]): """ Properly sets properties on player interface don't use this method from dbus interface, all values should be set from player (to keep them correct) """ if name == 'pause': oldval = self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] newval = None if val: newval = 'Paused' else: newval = 'Playing' if newval != oldval: self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] = newval self.PropertiesChanged(PLAYER_INTERFACE, { 'PlaybackStatus': newval }, []) elif name == 'stop': oldval = self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] newval = None if val: newval = 'Stopped' else: newval = 'Playing' if newval != oldval: self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] = newval self.PropertiesChanged(PLAYER_INTERFACE, { 'PlaybackStatus': newval }, ['Metadata', 'Position']) elif name == 'volume' and val is not None: oldval = self.properties[PLAYER_INTERFACE]['read_write']['Volume'] newval = float(val) / 100 if newval != oldval: self.properties[PLAYER_INTERFACE]['read_write']['Volume'] = newval self.PropertiesChanged(PLAYER_INTERFACE, { 'Volume': newval }, []) elif name == 'time-pos' and val: oldval = self.properties[PLAYER_INTERFACE]['read_only']['Position'] newval = dbus.Int64(val * 10**6) if val else dbus.Int64(0) if newval != oldval: self.properties[PLAYER_INTERFACE]['read_only']['Position'] = newval if abs(newval - oldval) >= 4 * 10**6: self.Seeked(newval) elif name == 'metadata' and val: trackid, title, length, arturl, artist, album = val # sanitize ytid - it uses '-_' which are not valid in dbus paths trackid_sanitized = re.sub('[^a-zA-Z0-9]', '', trackid) yturl = 'https://www.youtube.com/watch?v=' + trackid oldval = self.properties[PLAYER_INTERFACE]['read_only']['Metadata'] newval = { 'mpris:trackid' : dbus.ObjectPath( '/CurrentPlaylist/ytid/' + trackid_sanitized, variant_level=1), 'mpris:length' : dbus.Int64(length * 10**6, variant_level=1), 'mpris:artUrl' : dbus.String(arturl, variant_level=1), 'xesam:title' : dbus.String(title, variant_level=1), 'xesam:artist' : dbus.Array(artist, 's', 1), 'xesam:album' : dbus.String(album, variant_level=1), 'xesam:url' : dbus.String(yturl, variant_level=1), } if newval != oldval: self.properties[PLAYER_INTERFACE]['read_only']['Metadata'] = newval self.PropertiesChanged(PLAYER_INTERFACE, { 'Metadata': newval }, []) elif name == 'seeking': # send signal to keep time-pos synced between player and client if not val: self.Seeked(self.properties[PLAYER_INTERFACE]['read_only']['Position']) def _sendcommand(self, command): """ sends commands to binded player """ if self.socket: self.socket.send(json.dumps({"command": command}).encode() + b'\n') elif self.fifo: command = command[:] for x, i in enumerate(command): if i is True: command[x] = 'yes' if self.mpv else 1 elif i is False: command[x] = 'no' if self.mpv else 0 cmd = " ".join([str(i) for i in command]) + '\n' self.fifo.write(cmd) self.fifo.flush() # # implementing org.mpris.MediaPlayer2 # @dbus.service.method(dbus_interface=ROOT_INTERFACE) def Raise(self): """ Brings the media player's user interface to the front using any appropriate mechanism available. """ pass @dbus.service.method(dbus_interface=ROOT_INTERFACE) def Quit(self): """ Causes the media player to stop running. """ pass # # implementing org.mpris.MediaPlayer2.Player # @dbus.service.method(dbus_interface=PLAYER_INTERFACE) def Next(self): """ Skips to the next track in the tracklist. """ self._sendcommand(["quit"]) @dbus.service.method(PLAYER_INTERFACE) def Previous(self): """ Skips to the previous track in the tracklist. """ self._sendcommand(["quit", 42]) @dbus.service.method(PLAYER_INTERFACE) def Pause(self): """ Pauses playback. If playback is already paused, this has no effect. """ if self.mpv: self._sendcommand(["set_property", "pause", True]) else: if self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] != 'Paused': self._sendcommand(['pause']) @dbus.service.method(PLAYER_INTERFACE) def PlayPause(self): """ Pauses playback. If playback is already paused, resumes playback. """ if self.mpv: self._sendcommand(["cycle", "pause"]) else: self._sendcommand(["pause"]) @dbus.service.method(PLAYER_INTERFACE) def Stop(self): """ Stops playback. """ self._sendcommand(["quit", 43]) @dbus.service.method(PLAYER_INTERFACE) def Play(self): """ Starts or resumes playback. """ if self.mpv: self._sendcommand(["set_property", "pause", False]) else: if self.properties[PLAYER_INTERFACE]['read_only']['PlaybackStatus'] != 'Playing': self._sendcommand(['pause']) @dbus.service.method(PLAYER_INTERFACE, in_signature='x') def Seek(self, offset): """ Offset - x (offset) The number of microseconds to seek forward. Seeks forward in the current track by the specified number of microseconds. """ self._sendcommand(["seek", offset / 10**6]) @dbus.service.method(PLAYER_INTERFACE, in_signature='ox') def SetPosition(self, track_id, position): """ TrackId - o (track_id) The currently playing track's identifier. If this does not match the id of the currently-playing track, the call is ignored as "stale". Position - x (position) Track position in microseconds. Sets the current track position in microseconds. """ if track_id == self.properties[PLAYER_INTERFACE]['read_only']['Metadata']['mpris:trackid']: self._sendcommand(["seek", position / 10**6, 'absolute' if self.mpv else 2]) @dbus.service.method(PLAYER_INTERFACE, in_signature='s') def OpenUri(self, uri): """ Uri - s (uri) Uri of the track to load. Opens the Uri given as an argument. """ pass @dbus.service.signal(PLAYER_INTERFACE, signature='x') def Seeked(self, position): """ Position - x (position) The new position, in microseconds. Indicates that the track position has changed in a way that is inconsistant with the current playing state. """ pass # # implementing org.freedesktop.DBus.Properties # @dbus.service.method(dbus_interface=PROPERTIES_INTERFACE, in_signature='ss', out_signature='v') def Get(self, interface_name, property_name): """ getter for org.freedesktop.DBus.Properties on this object """ return self.GetAll(interface_name)[property_name] @dbus.service.method(dbus_interface=PROPERTIES_INTERFACE, in_signature='s', out_signature='a{sv}') def GetAll(self, interface_name): """ getter for org.freedesktop.DBus.Properties on this object """ if interface_name in self.properties: t = copy.copy(self.properties[interface_name]['read_only']) t.update(self.properties[interface_name]['read_write']) return t else: raise dbus.exceptions.DBusException( 'com.example.UnknownInterface', 'This object does not implement the %s interface' % interface_name) @dbus.service.method(dbus_interface=PROPERTIES_INTERFACE, in_signature='ssv') def Set(self, interface_name, property_name, new_value): """ setter for org.freedesktop.DBus.Properties on this object """ if interface_name in self.properties: if property_name in self.properties[interface_name]['read_write']: if property_name == 'Volume': self._sendcommand(["set_property", "volume", new_value * 100]) if self.fifo: # fix for mplayer (force update) self._sendcommand(['get_property', 'volume']) else: raise dbus.exceptions.DBusException( 'com.example.UnknownInterface', 'This object does not implement the %s interface' % interface_name) @dbus.service.signal(dbus_interface=PROPERTIES_INTERFACE, signature='sa{sv}as') def PropertiesChanged(self, interface_name, changed_properties, invalidated_properties): """ signal for org.freedesktop.DBus.Properties on this object this informs of changed properties """ pass class MprisConnection(object): """ Object encapsulating pipe for communication with Mpris2Controller. This object wraps send to ensure communicating process never crashes, even when Mpris2Controller existed or crashed. """ def __init__(self, connection): super(MprisConnection, self).__init__() self.connection = connection def send(self, obj): """ Send an object to the other end of the connection """ if self.connection: try: self.connection.send(obj) except BrokenPipeError: self.connection = None print('MPRIS process exited or crashed.') def main(connection): """ runs mpris interface and listens for changes connection - pipe to communicate with this module """ try: mprisctl = Mpris2Controller() except ImportError: # gi.repository import GLib print("could not load MPRIS interface. missing libraries.") return try: mprisctl.acquire() except dbus.exceptions.DBusException as e: print('mpris interface couldn\'t be initialized. reason: %s' % e.get_dbus_message()) return mprisctl.run(connection) mprisctl.release() ================================================ FILE: mps_youtube/pafy.py ================================================ import json import os import random import re from urllib.parse import parse_qs, urlparse import requests import yt_dlp from youtubesearchpython import * class MyLogger: def debug(self, msg): # For compatibility with youtube-dl, both debug and info are passed into debug # You can distinguish them by the prefix '[debug] ' if msg.startswith('[debug] '): pass else: self.info(msg) def info(self, msg): pass def warning(self, msg): pass def error(self, msg): print(msg) def get_video_streams(ytid): ''' given a youtube video id returns different video / audio stream formats' \ ''' with yt_dlp.YoutubeDL({'logger':MyLogger()}) as ydl: info_dict = ydl.extract_info(ytid, download=False) return [i for i in info_dict['formats'] if i.get('format_note') != 'storyboard'] def download_video(ytid, folder, audio_only=False): ''' Given a youtube video id and target folder, this function will download video to that folder ''' ytdl_format_options = { 'outtmpl': os.path.join(folder, '%(title)s-%(id)s.%(ext)s') } if audio_only: ytdl_format_options['format'] = 'bestaudio/best' ytdl_format_options['postprocessors'] =[{ 'key': 'FFmpegExtractAudio', 'preferredcodec': 'mp3', 'preferredquality': '192', }] with yt_dlp.YoutubeDL(ytdl_format_options) as ydl: ydl.download('https://www.youtube.com/watch?v=%s' % ytid) return True def search_videos(query, pages): ''' Given a keyword / query this function will return youtube video results against those keywords / query ''' videosSearch = VideosSearch(query, limit=50) wdata = videosSearch.result()['result'] for i in range(pages-1): videosSearch.next() wdata.extend(videosSearch.result()['result']) return wdata def channel_search(query): ''' Search channel based on keyword / query provided by user ''' channelsSearch = ChannelsSearch(query, limit=50, region='US') return channelsSearch.result()['result'] def playlist_search(query): ''' Returns all playlists having similar names as keyword / query provided ''' playlistsSearch = PlaylistsSearch(query, limit=50) return playlistsSearch.result()['result'] def get_playlist(playlist_id): ''' Get all videos of a playlist identified by playlist_id ''' playlist = Playlist('https://www.youtube.com/playlist?list=%s' % playlist_id) while playlist.hasMoreVideos: playlist.getNextVideos() return playlist def get_video_title_suggestions(query): suggestions = Suggestions(language = 'en', region = 'US') related_searches = suggestions.get(query)['result'] return related_searches[random.randint(0,len(related_searches))] def channel_id_from_name(query): channel_info = channel_search(query)[0] channel_id = channel_info['id'] channel_name = channel_info['title'] return (channel_id, channel_name) def all_videos_from_channel(channel_id): playlist = Playlist(playlist_from_channel_id(channel_id)) return playlist.videos def search_videos_from_channel(channel_id, query): search = ChannelSearch(query , channel_id) return search.result() def get_comments(video_id): comments = Comments.get(video_id) return comments['result'] def get_video_info(video_id): videoInfo = Video.getInfo(video_id) response = return_dislikes(video_id) videoInfo['likes'] = response['likes'] videoInfo['dislikes'] = response['dislikes'] videoInfo['averageRating'] = response['rating'] return videoInfo def return_dislikes(video_id): return json.loads(requests.get('https://returnyoutubedislikeapi.com/votes?videoId=' + video_id).text) def extract_video_id(url: str) -> str: """Extract the video id from a url, return video id as str. Args: url: url contain video id Returns: video id Raises: ValueError: If no video id found Examples: >>> extract_video_id('http://example.com') >>> extract_video_id('https://www.youtube.com/watch?v=LDU_Txk06tM') LDU_Txk06tM >>> extract_video_id('https://youtu.be/LDU_Txk06tM') LDU_Txk06tM """ idregx = re.compile(r'[\w-]{11}$') url = str(url).strip() if idregx.match(url): return url # ID of video if '://' not in url: url = '//' + url parsedurl = urlparse(url) if parsedurl.netloc in ('youtube.com', 'www.youtube.com', 'm.youtube.com', 'gaming.youtube.com'): query = parse_qs(parsedurl.query) if 'v' in query and idregx.match(query['v'][0]): return query['v'][0] elif parsedurl.netloc in ('youtu.be', 'www.youtu.be'): vidid = parsedurl.path.split('/')[-1] if parsedurl.path else '' if idregx.match(vidid): return vidid err = "Need 11 character video id or the URL of the video. Got %s" raise ValueError(err % url) def all_playlists_from_channel(channel_id): channel = Channel(channel_id) playlists = channel.result['playlists'] while channel.has_more_playlists(): channel.next() playlists.extend(channel.result["playlists"]) return playlists ================================================ FILE: mps_youtube/paths.py ================================================ import os mswin = os.name == "nt" def get_default_ddir(): """ Get system default Download directory, append mps dir. """ user_home = os.path.expanduser("~") join, exists = os.path.join, os.path.exists if mswin: return join(user_home, "Downloads", "yewtube") USER_DIRS = join(user_home, ".config", "user-dirs.dirs") DOWNLOAD_HOME = join(user_home, "Downloads") # define ddir by (1) env var, (2) user-dirs.dirs file, # (3) existing ~/Downloads dir (4) ~ if 'XDG_DOWNLOAD_DIR' in os.environ: ddir = os.environ['XDG_DOWNLOAD_DIR'] elif exists(USER_DIRS): lines = open(USER_DIRS).readlines() defn = [x for x in lines if x.startswith("XDG_DOWNLOAD_DIR")] if len(defn) == 1: ddir = defn[0].split("=")[1].replace('"', '') ddir = ddir.replace("$HOME", user_home).strip() else: ddir = DOWNLOAD_HOME if exists(DOWNLOAD_HOME) else user_home else: ddir = DOWNLOAD_HOME if exists(DOWNLOAD_HOME) else user_home ddir = ddir return os.path.join(ddir, "mps") def get_config_dir(): """ Get user's configuration directory. Migrate to new mps name if old.""" if mswin: confdir = os.environ["APPDATA"] elif 'XDG_CONFIG_HOME' in os.environ: confdir = os.environ['XDG_CONFIG_HOME'] else: confdir = os.path.join(os.path.expanduser("~"), '.config') mps_confdir = os.path.join(confdir, "mps-youtube") os.makedirs(mps_confdir, exist_ok=True) return mps_confdir ================================================ FILE: mps_youtube/player.py ================================================ import logging import math import os import random import shlex import socket import subprocess import sys import time from abc import ABCMeta, abstractmethod from urllib.error import HTTPError, URLError from . import c, config, content, g, history, screen, streams, util from .commands import lastfm from .util import not_utf8_environment mswin = os.name == "nt" class BasePlayer: _playbackStatus = "Paused" _last_displayed_line = None @property def PlaybackStatus(self): return self._playbackStatus @PlaybackStatus.setter def PlaybackStatus(self, value): self._playbackStatus = value if value == 'Playing': paused = False else: paused = True g.mprisctl.send(('pause', paused)) def play(self, songlist, shuffle=False, repeat=False, override=False): """ Play a range of songs, exit cleanly on keyboard interrupt. """ if config.ALWAYS_REPEAT.get: repeat = True self.songlist = songlist self.shuffle = shuffle self.repeat = repeat self.override = override if shuffle: random.shuffle(self.songlist) self.song_no = 0 while 0 <= self.song_no <= len(self.songlist)-1: self.song = self.songlist[self.song_no] g.content = self._playback_progress(self.song_no, self.songlist, repeat=repeat) if not g.command_line: screen.update(fill_blank=False) hasnext = len(self.songlist) > self.song_no + 1 if hasnext: streams.preload(self.songlist[self.song_no + 1], override=self.override) if config.SET_TITLE.get: util.set_window_title(self.song.title + " - yewtube") self.softrepeat = repeat and len(self.songlist) == 1 if g.scrobble: lastfm.set_now_playing(g.artist, g.scrobble_queue[self.song_no]) try: self.video, self.stream, self.override = stream_details( self.song, override=self.override, softrepeat=self.softrepeat) self._playsong() except KeyboardInterrupt: logging.info("Keyboard Interrupt") util.xprint(c.w + "Stopping... ") screen.reset_terminal() g.message = c.y + "Playback halted" + c.w raise KeyboardInterrupt break # skip forbidden, video removed/no longer available, etc. tracks except TypeError as e: import traceback traceback.print_exception(type(e), e, e.__traceback__) self.song_no += 1 pass if config.SET_TITLE.get: util.set_window_title("yewtube") if self.song_no == -1: self.song_no = len(songlist) - 1 if repeat else 0 elif self.song_no == len(self.songlist) and repeat: self.song_no = 0 # To be defined by subclass based on being cmd player or library # When overriding next and previous don't forget to add the following # if g.scrobble: # lastfm.scrobble_track(g.artist, g.album, g.scrobble_queue[self.song_no]) def next(self): pass def previous(self): pass def stop(self): pass ############### def seek(self): pass def _playsong(self, failcount=0, softrepeat=False): """ Play song using config.PLAYER called with args config.PLAYERARGS. """ # pylint: disable=R0911,R0912 if not config.PLAYER.get or not util.has_exefile(config.PLAYER.get): g.message = "Player not configured! Enter %sset player "\ "%s to set a player" % (c.g, c.w) return if config.NOTIFIER.get: subprocess.Popen(shlex.split(config.NOTIFIER.get) + [self.song.title]) size = streams.get_size(self.song.ytid, self.stream['url']) songdata = (self.song.ytid, '' if self.stream.get('ext') is None else self.stream.get('ext') + " " + self.stream['quality'], int(size / (1024 ** 2))) self.songdata = "%s; %s; %s Mb" % songdata screen.writestatus(self.songdata) self._launch_player() if config.HISTORY.get: history.add(self.song) def _launch_player(self): """ Launch player application. """ pass def send_metadata_mpris(self): metadata = util._get_metadata(self.song.title) if config.LOOKUP_METADATA.get else None if metadata is None: arturl = "https://i.ytimg.com/vi/%s/default.jpg" % self.song.ytid metadata = (self.song.ytid, self.song.title, self.song.length, arturl, [''], '') else: arturl = metadata['album_art_url'] metadata = (self.song.ytid, metadata['track_title'], self.song.length, arturl, [metadata['artist']], metadata['album']) if g.mprisctl: g.mprisctl.send(('metadata', metadata)) def _playback_progress(self, idx, allsongs, repeat=False): """ Generate string to show selected tracks, indicate current track. """ # pylint: disable=R0914 # too many local variables cw = util.getxy().width out = " %s%-XXs%s%s\n".replace("XX", str(cw - 9)) out = out % (c.ul, "Title", "Time", c.w) multi = len(allsongs) > 1 for n, song in enumerate(allsongs): length_orig = util.fmt_time(song.length) length = " " * (8 - len(length_orig)) + length_orig i = util.uea_pad(cw - 14, song.title), length, length_orig fmt = (c.w, " ", c.b, i[0], c.w, c.y, i[1], c.w) if n == idx: fmt = (c.y, "> ", c.p, i[0], c.w, c.p, i[1], c.w) cur = i out += "%s%s%s%s%s %s%s%s\n" % fmt out += "\n" * (3 - len(allsongs)) pos = 8 * " ", c.y, idx + 1, c.w, c.y, len(allsongs), c.w playing = "{}{}{}{} of {}{}{}\n\n".format(*pos) if multi else "\n\n" keys = self._help(short=(not multi and not repeat)) out = out if multi else content.generate_songlist_display(song=allsongs[0]) if config.SHOW_PLAYER_KEYS.get and keys is not None: out += "\n" + keys else: playing = "{}{}{}{} of {}{}{}\n".format(*pos) if multi else "\n" out += "\n" + " " * (cw - 19) if multi else "" fmt = playing, c.r, cur[0].strip()[:cw - 19], c.w, c.w, cur[2], c.w out += "%s %s%s%s %s[%s]%s" % fmt out += " REPEAT MODE" if repeat else "" return out def make_status_line(self, elapsed_s, prefix, songlength=0, volume=None): self._line = self._make_status_line(elapsed_s, prefix, songlength, volume=volume) if self._line != self._last_displayed_line: screen.writestatus(self._line) self._last_displayed_line = self._line def _make_status_line(self, elapsed_s, prefix, songlength=0, volume=None): """ Format progress line output. """ # pylint: disable=R0914 display_s = elapsed_s display_h = display_m = 0 if elapsed_s >= 60: display_m = display_s // 60 display_s %= 60 if display_m >= 60: display_h = display_m // 60 display_m %= 60 pct = (float(elapsed_s) / songlength * 100) if songlength else 0 status_line = "%02i:%02i:%02i %s" % ( display_h, display_m, display_s, ("[%.0f%%]" % pct).ljust(6) ) if volume: vol_suffix = " vol: %d%%" % volume else: vol_suffix = "" cw = util.getxy().width prog_bar_size = cw - len(prefix) - len(status_line) - len(vol_suffix) - 7 progress = int(math.ceil(pct / 100 * prog_bar_size)) status_line += " [%s]" % ("=" * (progress - 1) + ">").ljust(prog_bar_size, ' ') return prefix + status_line + vol_suffix class CmdPlayer(BasePlayer): def next(self): if g.scrobble: lastfm.scrobble_track(g.artist, g.album, g.scrobble_queue[self.song_no]) self.terminate_process() self.song_no += 1 def previous(self): if g.scrobble: lastfm.scrobble_track(g.artist, g.album, g.scrobble_queue[self.song_no]) self.terminate_process() self.song_no -= 1 def stop(self): self.terminate_process() self.song_no = len(self.songlist) def terminate_process(self): self.p.terminate() # If using shell=True or the player # requires some obscure way of killing the process # the child class can define this function def _generate_real_playerargs(self): pass def clean_up(self): pass def launch_player(self, cmd): pass def _help(self, short=True): pass def _launch_player(self): """ Launch player application. """ cmd = self._generate_real_playerargs() util.dbg("playing %s", self.song.title) util.dbg("calling %s", " ".join(cmd)) # Fix UnicodeEncodeError when title has characters # not supported by encoding cmd = [util.xenc(i) for i in cmd] self.send_metadata_mpris() try: self.launch_player(cmd) except OSError: g.message = util.F('no player') % config.PLAYER.get return None finally: if g.mprisctl: g.mprisctl.send(('stop', True)) if self.p and self.p.poll() is None: self.p.terminate() # make sure to kill mplayer if yewtube crashes self.clean_up() def stream_details(song, failcount=0, override=False, softrepeat=False): """Fetch stream details for a song.""" # don't interrupt preloading: while song.ytid in g.preloading: screen.writestatus("fetching item..") time.sleep(0.1) try: streams.get(song, force=failcount, callback=screen.writestatus) except (IOError, URLError, HTTPError, socket.timeout) as e: util.dbg("--ioerror in stream_details call to streams.get %s", str(e)) if "Youtube says" in str(e): g.message = util.F('cant get track') % (song.title + " " + str(e)) return elif failcount < g.max_retries: util.dbg("--ioerror - trying next stream") failcount += 1 return stream_details(song, failcount=failcount, override=override, softrepeat=softrepeat) elif "pafy" in str(e): g.message = str(e) + " - " + song.ytid return except ValueError: g.message = util.F('track unresolved') util.dbg("----valueerror in stream_details call to streams.get") return if failcount == g.max_retries: raise TypeError() try: video = ((config.SHOW_VIDEO.get and override != "audio") or (override in ("fullscreen", "window", "forcevid"))) m4a = "mplayer" not in config.PLAYER.get cached = g.streams[song.ytid] stream = streams.select(cached, q=failcount, audio=(not video), m4a_ok=m4a) # handle no audio stream available, or m4a with mplayer # by switching to video stream and suppressing video output. if (not stream or failcount) and not video: util.dbg(c.r + "no audio or mplayer m4a, using video stream" + c.w) override = "a-v" video = True stream = streams.select(cached, q=failcount, audio=False, maxres=1600) if not stream: raise IOError("No streams available") return (video, stream, override) except (HTTPError) as e: # Fix for invalid streams (gh-65) util.dbg("----htterror in stream_details call to gen_real_args %s", str(e)) if failcount < g.max_retries: failcount += 1 return stream_details(song, failcount=failcount, override=override, softrepeat=softrepeat) else: g.message = str(e) return except IOError as e: # this may be cause by attempting to play a https stream with # mplayer # ==== errmsg = e.message if hasattr(e, "message") else str(e) g.message = c.r + str(errmsg) + c.w return ================================================ FILE: mps_youtube/players/GenericPlayer.py ================================================ import os import subprocess from .. import config from ..player import CmdPlayer # # This class can be used as a templete for new players # # NOTE: # If you're defining a new player donot forget # to name both the class and file the same as your player # class GenericPlayer(CmdPlayer): def __init__(self, player): self.player = player def _generate_real_playerargs(self): '''Generates player arguments to called using Popen ''' args = config.PLAYERARGS.get.strip().split() ############################################ # Define your arguments below this line ########################################### return [self.player] + args + [self.stream['url']] def clean_up(self): ''' Cleans up temp files after process exits. ''' pass def launch_player(self, cmd): ################################################## # Change this however you want with open(os.devnull, "w") as devnull: self.p = subprocess.Popen(cmd, shell=False, stderr=devnull) self.p.wait() ################################################## # Donot forget self.next() self.next() def _help(self, short=True): ''' Help keys shown when the song is played. See mpv.py for reference. ''' pass ================================================ FILE: mps_youtube/players/__init__.py ================================================ ================================================ FILE: mps_youtube/players/mplayer.py ================================================ import os import re import subprocess import sys import tempfile import typing as T from .. import c, config, g, paths, screen, util from ..player import CmdPlayer from ..util import not_utf8_environment mswin = os.name == "nt" class mplayer(CmdPlayer): def __init__(self, player): self.player = player self.mplayer_version = _get_mplayer_version(player) def _generate_real_playerargs(self): """ Generate args for player command. Return args. """ if "uiressl=yes" in self.stream['url']: ver = self.mplayer_version # Mplayer too old to support https if not (ver > (1, 1) if isinstance(ver, tuple) else ver >= 37294): raise IOError("%s : Sorry mplayer doesn't support this stream. " "Use mpv or update mplayer to a newer version" % self.song.title) args = config.PLAYERARGS.get.strip().split() pd = g.playerargs_defaults['mplayer'] args.extend((pd["title"], '"{0}"'.format(self.song.title))) if pd['geo'] not in args: geometry = config.WINDOW_SIZE.get or "" if config.WINDOW_POS.get: wp = config.WINDOW_POS.get xx = "+1" if "left" in wp else "-1" yy = "+1" if "top" in wp else "-1" geometry += xx + yy if geometry: args.extend((pd['geo'], geometry)) # handle no audio stream available if self.override == "a-v": util.list_update(pd["novid"], args) elif ((config.FULLSCREEN.get and self.override != "window") or self.override == "fullscreen"): util.list_update(pd["fs"], args) # prevent ffmpeg issue (https://github.com/mpv-player/mpv/issues/579) if not self.video and self.stream['ext'] == "m4a": util.dbg("%susing ignidx flag%s") util.list_update(pd["ignidx"], args) if g.volume: util.list_update("-volume", args) util.list_update(str(g.volume), args) util.list_update("-really-quiet", args, remove=True) util.list_update("-noquiet", args) util.list_update("-prefer-ipv4", args) util.list_update("-cache", args) util.list_update("4096", args) return [self.player] + args + [self.stream['url']] def clean_up(self): if self.fifopath: os.unlink(self.fifopath) def launch_player(self, cmd): self.input_file = _get_input_file() self.sockpath = None self.fifopath = None cmd.append('-input') if mswin: # Mplayer does not recognize path starting with drive letter, # or with backslashes as a delimiter. self.input_file = self.input_file[2:].replace('\\', '/') cmd.append('conf=' + self.input_file) if g.mprisctl: self.fifopath = tempfile.mktemp('.fifo', 'mpsyt-mplayer') os.mkfifo(self.fifopath) cmd.extend(['-input', 'file=' + self.fifopath]) g.mprisctl.send(('mplayer-fifo', self.fifopath)) self.p = subprocess.Popen(cmd, shell=False, stdout=subprocess.PIPE, stderr=subprocess.STDOUT, bufsize=0) self._player_status(self.songdata + "; ", self.song.length) returncode = self.p.wait() print(returncode) if returncode == 42: self.previous() elif returncode == 43: self.stop() else: self.next() def _player_status(self, prefix, songlength=0): """ Capture time progress from player output. Write status line. """ # pylint: disable=R0914, R0912 re_player = re.compile(r"A:\s*(?P\d+)\.\d\s*") re_volume = re.compile(r"Volume:\s*(?P\d+)\s*%") last_displayed_line = None buff = '' volume_level = None last_pos = None elapsed_s = 0 while self.p.poll() is None: stdstream = self.p.stdout char = stdstream.read(1).decode("utf-8", errors="ignore") if char in '\r\n': mv = re_volume.search(buff) if mv: volume_level = int(mv.group("volume")) match_object = re_player.match(buff) if match_object: try: h, m, s = map(int, match_object.groups()) elapsed_s = h * 3600 + m * 60 + s except ValueError: try: elapsed_s = int(match_object.group('elapsed_s') or '0') except ValueError: continue if volume_level and volume_level != g.volume: g.volume = volume_level self.make_status_line(elapsed_s, prefix, songlength, volume=volume_level) if buff.startswith('ANS_volume='): volume_level = round(float(buff.split('=')[1])) paused = ("PAUSE" in buff) or ("Paused" in buff) if (elapsed_s != last_pos or paused) and g.mprisctl: last_pos = elapsed_s g.mprisctl.send(('pause', paused)) g.mprisctl.send(('volume', volume_level)) g.mprisctl.send(('time-pos', elapsed_s)) buff = '' else: buff += char def _help(self, short=True): """ Mplayer help. """ volume = "[{0}9{1}] volume [{0}0{1}] [{0}CTRL-C{1}] return" seek = "[{0}\u2190{1}] seek [{0}\u2192{1}]" pause = "[{0}\u2193{1}] SEEK [{0}\u2191{1}] [{0}space{1}] pause" if not_utf8_environment: seek = "[{0}<-{1}] seek [{0}->{1}]" pause = "[{0}DN{1}] SEEK [{0}UP{1}] [{0}space{1}] pause" single = "[{0}q{1}] next" next_prev = "[{0}>{1}] next/prev [{0}<{1}]" # ret = "[{0}q{1}] %s" % ("return" if short else "next track") ret = single if short and config.AUTOPLAY.get else "" ret = next_prev if not short else ret fmt = " %-20s %-20s" lines = fmt % (seek, volume) + "\n" + fmt % (pause, ret) return lines.format(c.g, c.w) def _get_input_file(): """ Check for existence of custom input file. Return file name of temp input file with yewtube mappings included """ confpath = conf = '' confpath = os.path.join(paths.get_config_dir(), "mplayer-input.conf") if os.path.isfile(confpath): util.dbg("using %s for input key file", confpath) with open(confpath) as conffile: conf = conffile.read() + '\n' conf = conf.replace("quit", "quit 43") conf = conf.replace("playlist_prev", "quit 42") conf = conf.replace("pt_step -1", "quit 42") conf = conf.replace("playlist_next", "quit") conf = conf.replace("pt_step 1", "quit") standard_cmds = ['q quit 43\n', '> quit\n', '< quit 42\n', 'NEXT quit\n', 'PREV quit 42\n', 'ENTER quit\n'] bound_keys = [i.split()[0] for i in conf.splitlines() if i.split()] for i in standard_cmds: key = i.split()[0] if key not in bound_keys: conf += i with tempfile.NamedTemporaryFile('w', prefix='mpsyt-input', delete=False) as tmpfile: tmpfile.write(conf) return tmpfile.name def _get_mplayer_version(exename: str) -> T.Union[int, T.Tuple[int, ...]]: """get mplayer version. Args: exename: mplayer executable name. Returns: single integer value or tuple of mplayer version. Return `0` if failed Raises: OSError: if `exename` is invalid FileNotFoundError: if no mplayer found PermissionError: if user dont have permission to run `exename` TypeError: if `exename` return invalid type """ try: o = subprocess.check_output([exename]).decode() except FileNotFoundError: raise m = re.search(r"MPlayer \S*?SVN[\s-]r([0-9]+)", o, re.MULTILINE | re.IGNORECASE) ver = 0 if m: ver = int(m.groups()[0]) else: m = re.search('MPlayer ([0-9])+.([0-9]+)', o, re.MULTILINE) if m: ver = tuple(int(i) for i in m.groups()) else: util.dbg("%sFailed to detect mplayer version%s", c.r, c.w) return ver ================================================ FILE: mps_youtube/players/mpv.py ================================================ import json import os import re import socket import subprocess import sys import tempfile import time from .. import c, config, g, paths, screen, util from ..player import CmdPlayer from ..util import not_utf8_environment mswin = os.name == "nt" class mpv(CmdPlayer): def __init__(self, player): self.player = player self.mpv_version = _get_mpv_version(player) self.mpv_options = subprocess.check_output( [player, "--list-options"]).decode() self.mpv_usesock = "" if not mswin: if "--input-unix-socket" in self.mpv_options: self.mpv_usesock = "--input-unix-socket" util.dbg(c.g + "mpv supports --input-unix-socket" + c.w) elif "--input-ipc-server" in self.mpv_options: self.mpv_usesock = "--input-ipc-server" util.dbg(c.g + "mpv supports --input-ipc-server" + c.w) def _generate_real_playerargs(self): """ Generate args for player command. Return args. """ args = config.PLAYERARGS.get.strip().split() pd = g.playerargs_defaults['mpv'] # Use new mpv syntax # https://github.com/mps-youtube/mps-youtube/issues/1052 completetitle = '='.join((pd["title"], '"{0}"'.format(self.song.title))) util.list_update(completetitle, args) if pd['geo'] not in args: geometry = config.WINDOW_SIZE.get or "" if config.WINDOW_POS.get: wp = config.WINDOW_POS.get xx = "+1" if "left" in wp else "-1" yy = "+1" if "top" in wp else "-1" geometry += xx + yy if geometry: # Use new mpv syntax # See: https://github.com/mps-youtube/mps-youtube/issues/1052 newgeometry = '='.join((pd['geo'], geometry)) util.list_update(newgeometry, args) # handle no audio stream available if self.override == "a-v": util.list_update(pd["novid"], args) elif ((config.FULLSCREEN.get and self.override != "window") or self.override == "fullscreen"): util.list_update(pd["fs"], args) # prevent ffmpeg issue (https://github.com/mpv-player/mpv/issues/579) if not self.video and self.stream['ext'] == "m4a": util.dbg("%susing ignidx flag%s") util.list_update(pd["ignidx"], args) if "--ytdl" in self.mpv_options: util.list_update("--no-ytdl", args) msglevel = pd["msglevel"]["<0.4"] # undetected (negative) version number assumed up-to-date if self.mpv_version[0:2] < (0, 0) or self.mpv_version[0:2] >= (0, 4): msglevel = pd["msglevel"][">=0.4"] if not g.debug_mode: if self.mpv_usesock: util.list_update("--really-quiet", args) else: util.list_update("--really-quiet", args, remove=True) util.list_update(msglevel, args) if g.volume: util.list_update("--volume=" + str(g.volume), args) if self.softrepeat: util.list_update("--loop-file", args) if not config.SHOW_VIDEO.get: util.list_update('--no-video', args) util.list_update('--vid=no', args) return [self.player] + args + [self.stream['url']] def clean_up(self): if self.input_file: os.unlink(self.input_file) if self.sockpath and os.path.exists(self.sockpath): os.unlink(self.sockpath) if self.fifopath and os.path.exists(self.fifopath): os.unlink(self.fifopath) def launch_player(self, cmd): self.input_file = _get_input_file() cmd.append('--input-conf=' + self.input_file) self.sockpath = None self.fifopath = None if self.mpv_usesock: self.sockpath = tempfile.mktemp('.sock', 'mpsyt-mpv') cmd.append(self.mpv_usesock + '=' + self.sockpath) with open(os.devnull, "w") as devnull: self.p = subprocess.Popen(cmd, shell=False, stderr=devnull) if g.mprisctl: g.mprisctl.send(('socket', self.sockpath)) else: if g.mprisctl: self.fifopath = tempfile.mktemp('.fifo', 'mpsyt-mpv') os.mkfifo(self.fifopath) cmd.append('--input-file=' + self.fifopath) g.mprisctl.send(('mpv-fifo', self.fifopath)) self.p = subprocess.Popen(cmd, shell=False, stderr=subprocess.PIPE, bufsize=0) self._player_status(self.songdata + "; ", self.song.length) returncode = self.p.wait() if returncode == 42: self.previous() elif returncode == 43: self.stop() else: self.next() def _player_status(self, prefix, songlength=0): """ Capture time progress from player output. Write status line. """ # pylint: disable=R0914, R0912 re_player = re.compile(r".{,15}AV?:\s*(\d\d):(\d\d):(\d\d)") re_volume = re.compile(r"Volume:\s*(?P\d+)\s*%") last_displayed_line = None buff = '' volume_level = None last_pos = None if self.sockpath: s = socket.socket(socket.AF_UNIX) tries = 0 while tries < 10 and self.p.poll() is None: time.sleep(.5) try: s.connect(self.sockpath) break except socket.error: pass tries += 1 else: return try: observe_full = False cmd = {"command": ["observe_property", 1, "time-pos"]} s.send(json.dumps(cmd).encode() + b'\n') volume_level = elapsed_s = None for line in s.makefile(): resp = json.loads(line) # deals with bug in mpv 0.7 - 0.7.3 if resp.get('event') == 'property-change' and not observe_full: cmd = {"command": ["observe_property", 2, "volume"]} s.send(json.dumps(cmd).encode() + b'\n') observe_full = True if resp.get('event') == 'property-change' and resp['id'] == 1: if resp.get('data') is not None: elapsed_s = int(resp['data']) elif resp.get('event') == 'property-change' and resp['id'] == 2: volume_level = int(resp['data']) if(volume_level and volume_level != g.volume): g.volume = volume_level if elapsed_s: self.make_status_line(elapsed_s, prefix, songlength, volume=volume_level) except socket.error: pass else: elapsed_s = 0 while self.p.poll() is None: stdstream = self.p.stderr char = stdstream.read(1).decode("utf-8", errors="ignore") if char in '\r\n': mv = re_volume.search(buff) if mv: volume_level = int(mv.group("volume")) match_object = re_player.match(buff) if match_object: try: h, m, s = map(int, match_object.groups()) elapsed_s = h * 3600 + m * 60 + s except ValueError: try: elapsed_s = int(match_object.group('elapsed_s') or '0') except ValueError: continue if volume_level and volume_level != g.volume: g.volume = volume_level self.make_status_line(elapsed_s, prefix, songlength, volume=volume_level) if buff.startswith('ANS_volume='): volume_level = round(float(buff.split('=')[1])) paused = ("PAUSE" in buff) or ("Paused" in buff) if (elapsed_s != last_pos or paused) and g.mprisctl: last_pos = elapsed_s g.mprisctl.send(('pause', paused)) g.mprisctl.send(('volume', volume_level)) g.mprisctl.send(('time-pos', elapsed_s)) buff = '' else: buff += char def _help(self, short=True): """ Mplayer help. """ volume = "[{0}9{1}] volume [{0}0{1}] [{0}CTRL-C{1}] return" seek = "[{0}\u2190{1}] seek [{0}\u2192{1}]" pause = "[{0}\u2193{1}] SEEK [{0}\u2191{1}] [{0}space{1}] pause" if not_utf8_environment: seek = "[{0}<-{1}] seek [{0}->{1}]" pause = "[{0}DN{1}] SEEK [{0}UP{1}] [{0}space{1}] pause" single = "[{0}q{1}] next" next_prev = "[{0}>{1}] next/prev [{0}<{1}]" # ret = "[{0}q{1}] %s" % ("return" if short else "next track") ret = single if short and config.AUTOPLAY.get else "" ret = next_prev if not short else ret fmt = " %-20s %-20s" lines = fmt % (seek, volume) + "\n" + fmt % (pause, ret) return lines.format(c.g, c.w) def _get_input_file(): """ Check for existence of custom input file. Return file name of temp input file with yewtube mappings included """ confpath = conf = '' confpath = os.path.join(paths.get_config_dir(), "mpv-input.conf") if os.path.isfile(confpath): util.dbg("using %s for input key file", confpath) with open(confpath) as conffile: conf = conffile.read() + '\n' conf = conf.replace("quit", "quit 43") conf = conf.replace("playlist_prev", "quit 42") conf = conf.replace("pt_step -1", "quit 42") conf = conf.replace("playlist_next", "quit") conf = conf.replace("pt_step 1", "quit") standard_cmds = ['q quit 43\n', '> quit\n', '< quit 42\n', 'NEXT quit\n', 'PREV quit 42\n', 'ENTER quit\n', 'Q quit-watch-later'] bound_keys = [i.split()[0] for i in conf.splitlines() if i.split()] for i in standard_cmds: key = i.split()[0] if key not in bound_keys: conf += i with tempfile.NamedTemporaryFile('w', prefix='mpsyt-input', delete=False) as tmpfile: tmpfile.write(conf) return tmpfile.name def _get_mpv_version(exename): """ Get version of mpv as 3-tuple. """ o = subprocess.check_output([exename, "--version"]).decode() re_ver = re.compile(r"mpv (\d+)\.(\d+)\.(\d+)") for line in o.split("\n"): m = re_ver.match(line) if m: v = tuple(map(int, m.groups())) util.dbg("%s version %s.%s.%s detected", exename, *v) return v util.dbg("%sFailed to detect mpv version%s", c.r, c.w) return -1, 0, 0 ================================================ FILE: mps_youtube/players/vlc.py ================================================ import os import subprocess from .. import config, g, util from ..player import CmdPlayer class vlc(CmdPlayer): def __init__(self, player): self.player = player def _generate_real_playerargs(self): args = config.PLAYERARGS.get.strip().split() pd = g.playerargs_defaults['vlc'] args.extend((pd["title"], '"{0}"'.format(self.song.title))) if config.VLC_DUMMY_INTERFACE.get: print('[VLC DUMMY INTERFACE] Playing "{0}" ...'.format(self.song.title)) args.extend(('-I', 'dummy')) # vlc without gui if not config.SHOW_VIDEO.get: args.extend(("--no-video",)) util.list_update("--play-and-exit", args) return [self.player] + args + [self.stream['url']] def clean_up(self): self._kill_instance() def launch_player(self, cmd): with open(os.devnull, "w") as devnull: self.p = subprocess.Popen(cmd, shell=False, stderr=devnull) self.p.wait() self.next() def _help(self, short=True): pass def _kill_instance(self): import os from sys import platform if platform == "linux" or platform == "linux2": os.system('pkill -f vlc') elif platform == "darwin": os.system('killall vlc') elif platform == "win32": os.system('taskkill /im vlc.exe /f') # https://stackoverflow.com/questions/49988/really-killing-a-process-in-windows ================================================ FILE: mps_youtube/playlist.py ================================================ class Playlist: """ Representation of a playist, has list of songs. """ def __init__(self, name=None, songs=None): """ class members. """ self.name = name self.songs = songs or [] def __len__(self): """ Return number of tracks. """ return len(self.songs) def __getitem__(self, sliced): return self.songs[sliced] def __setitem__(self, position, item): self.songs[position] = item def __iter__(self): for i in self.songs: yield i @property def duration(self): """ Sum duration of the playlist. """ duration = sum(s.length for s in self.songs) mins, secs = divmod(duration, 60) hours, mins = divmod(mins, 60) duration = '{H:02}:{M:02}:{S:02}'.format(H=hours, M=mins, S=secs) return duration class Video: """ Class to represent a YouTube video. """ description = "" def __init__(self, ytid, title, length): """ class members. """ self.ytid = ytid self.title = title self.length = int(length) ================================================ FILE: mps_youtube/playlists.py ================================================ import os import sys import pickle from . import g, c, screen, util, pafy from .playlist import Playlist, Video def save(): """ Save playlists. Called each time a playlist is saved or deleted. """ for pl in g.userpl: with open(os.path.join(g.PLFOLDER, pl+'.m3u'), 'w') as plf: plf.write('#EXTM3U\n\n') for song in g.userpl[pl].songs: plf.write('#EXTINF:%d,%s\n' % (song.length, song.title)) plf.write('https://www.youtube.com/watch?v=%s\n' % song.ytid) util.dbg(c.r + "Playlist saved\n---" + c.w) def load(): """ Open playlists. Called once on script invocation. """ _convert_playlist_to_v2() _convert_playlist_to_m3u() try: # Loop through all files ending in '.m3u' for m3u in [m3u for m3u in os.listdir(g.PLFOLDER) if m3u[-4:] == '.m3u']: g.userpl[m3u[:-4]] = read_m3u(os.path.join(g.PLFOLDER, m3u)) except FileNotFoundError: # No playlist folder, create an empty one if not os.path.isdir(g.PLFOLDER): g.userpl = {} os.mkdir(g.PLFOLDER) save() # remove any cached urls from playlist file, these are now # stored in a separate cache file do_save = False for k, v in g.userpl.items(): for song in v.songs: if hasattr(song, "urls"): util.dbg("remove %s: %s", k, song.urls) del song.urls do_save = True if do_save: save() def delete(name): """ Delete playlist, including m3u file. """ del g.userpl[name] os.remove(os.path.join(g.PLFOLDER, name + '.m3u')) def read_m3u(m3u): """ Processes an m3u file into a Playlist object. """ name = os.path.basename(m3u)[:-4] songs = [] expect_ytid = False with open(m3u, 'r') as plf: if plf.readline().startswith('#EXTM3U'): for line in plf: if line.startswith('#EXTINF:') and not expect_ytid: duration, title = line.replace('#EXTINF:', '').strip().split(',', 1) expect_ytid = True elif not line.startswith('\n') and not line.startswith('#') and expect_ytid: try: expect_ytid = False ytid = pafy.extract_video_id(line).strip() songs.append(Video(ytid, title, int(duration))) except ValueError as ex: util.dbg(c.r + str(ex) + c.w) # Handles a simple m3u file which should just be a list of urls else: plf.seek(0) for line in plf: if not line.startswith('#'): try: p = util.get_pafy(line) songs.append(Video(p.videoid, p.title, p.length)) except (IOError, ValueError) as e: util.dbg(c.r + "Error loading video: " + str(e) + c.w) return Playlist(name, songs) def _convert_playlist_to_v2(): """ Convert previous playlist file to v2 playlist. """ # skip if previously done if os.path.isfile(g.PLFILE): return # skip if no playlist files exist elif not os.path.isfile(g.OLD_PLFILE): return try: with open(g.OLD_PLFILE, "rb") as plf: old_playlists = pickle.load(plf) except IOError: sys.exit("Couldn't open old playlist file") # rename old playlist file backup = g.OLD_PLFILE + "_v1_backup" if os.path.isfile(backup): sys.exit("Error, backup exists but new playlist exists not!") os.rename(g.OLD_PLFILE, backup) # do the conversion for plname, plitem in old_playlists.items(): songs = [] for video in plitem.songs: v = Video(video['link'], video['title'], video['duration']) songs.append(v) g.userpl[plname] = Playlist(plname, songs) # save as v2 os.mkdir(g.PLFOLDER) save() def _convert_playlist_to_m3u(): """ Convert playlist_v2 file to the m3u format. This should create a .m3u playlist for each playlist in playlist_v2. """ # Skip if playlists folder exists if os.path.isdir(g.PLFOLDER): return # Skip if no playlist files exist elif not os.path.isfile(g.PLFILE): return try: with open(g.PLFILE, 'rb') as plf: old_playlists = pickle.load(plf) except AttributeError: # playlist is from a time when this module was __main__ # https://github.com/np1/mps-youtube/issues/214 import __main__ __main__.Playlist = Playlist __main__.Video = Video from . import main main.Playlist = Playlist main.Video = Video with open(g.PLFILE, "rb") as plf: g.userpl = pickle.load(plf) os.mkdir(g.PLFOLDER) save() screen.msgexit("Updated playlist file. Please restart yewtube", 1) except EOFError: screen.msgexit("Error opening playlists from %s" % g.PLFILE, 1) except IOError: sys.exit("Couldn't open old playlist file") for pl in old_playlists: songs = [] for song in old_playlists[pl]: songs.append(song) g.userpl[pl] = Playlist(pl, songs) os.mkdir(g.PLFOLDER) save() ================================================ FILE: mps_youtube/screen.py ================================================ import subprocess import os import sys from . import g, content, config, util mswin = os.name == "nt" def update(fill_blank=True): """ Display content, show message, blank screen.""" clear() if isinstance(g.content, content.PaginatedContent): util.xprint(g.content.getPage(g.current_page)) g.rprompt = content.page_msg(g.current_page) elif g.content: util.xprint(g.content) g.content = False if g.message or g.rprompt: out = g.message or '' blanks = util.getxy().width - len(out) - len(g.rprompt or '') out += ' ' * blanks + (g.rprompt or '') util.xprint(out) elif fill_blank: util.xprint("") g.message = g.rprompt = False def clear(): """Clear all text from screen.""" if g.no_clear_screen: util.xprint('--\n') else: util.xprint('\n' * 200) def reset_terminal(): """ Reset terminal control character and modes for non Win OS's. """ if not mswin: subprocess.call(["tset", "-c"]) def writestatus(text, mute=False): """ Update status line. """ if not mute and config.SHOW_STATUS.get: _writeline(text) def _writeline(text): """ Print text on same line. """ width = util.getxy().width spaces = width - len(text) - 1 if mswin: # Avoids creating new line every time it is run # TODO: Figure out why this is needed spaces =- 1 text = text[:width - 3] sys.stdout.write(" " + text + (" " * spaces) + "\r") sys.stdout.flush() def msgexit(msg, code=0): """ Print a message and exit. """ util.xprint(msg) sys.exit(code) ================================================ FILE: mps_youtube/streams.py ================================================ import time import threading from urllib.request import urlopen from . import pafy from . import g, c, screen, config, util def prune(): """ Keep cache size in check. """ while len(g.pafs) > g.max_cached_streams: g.pafs.popitem(last=False) while len(g.streams) > g.max_cached_streams: g.streams.popitem(last=False) # prune time expired items now = time.time() oldpafs = [k for k in g.pafs if g.pafs[k] is not None and g.pafs[k].expiry < now] if len(oldpafs): util.dbg(c.r + "%s old pafy items pruned%s", len(oldpafs), c.w) for oldpaf in oldpafs: g.pafs.pop(oldpaf, 0) oldstreams = [k for k in g.streams if g.streams[k]['expiry'] is None or g.streams[k]['expiry'] < now] if len(oldstreams): util.dbg(c.r + "%s old stream items pruned%s", len(oldstreams), c.w) for oldstream in oldstreams: g.streams.pop(oldstream, 0) util.dbg(c.b + "paf: %s, streams: %s%s", len(g.pafs), len(g.streams), c.w) def get(vid, force=False, callback=None, threeD=False): """ Get all streams as a dict. callback function passed to get_pafy. """ now = time.time() ytid = vid.ytid have_stream = g.streams.get(ytid) and (g.streams[ytid]['expiry'] > now if g.streams[ytid]['expiry'] is not None else False) prfx = "preload: " if not callback else "" if not force and have_stream: ss = str(int(g.streams[ytid]['expiry'] - now) // 60) util.dbg("%s%sGot streams from cache (%s mins left)%s", c.g, prfx, ss, c.w) return g.streams.get(ytid)['meta'] #p = None#util.get_pafy(vid, force=force, callback=callback) #ps = p.allstreams if threeD else [x for x in p.allstreams if not x.threed] ps = pafy.get_video_streams(ytid) try: # test urls are valid [x['url'] for x in ps] except TypeError: # refetch if problem util.dbg("%s****Type Error in get_streams. Retrying%s", c.r, c.w) p = util.get_pafy(vid, force=True, callback=callback) ps = p.allstreams if threeD else [x for x in p.allstreams if not x.threed] streams = [{"url": s['url'], "ext": s['ext'], "quality": s['resolution'], "rawbitrate": s.get('bitrate',-1), "mtype": 'audio' if 'audio' in s['resolution'] else ('video' if s['acodec'] != 'none' else '?'), "size": int(s.get('filesize') if s.get('filesize') is not None else s.get('filesize_approx', -1))} for s in ps] if 'manifest' in streams[0]['url']: expiry = float(streams[0]['url'].split('/expire/')[1].split('/')[0]) else: temp = streams[0]['url'].split('expire=')[1] expiry = float(temp[:temp.find('&')]) g.streams[ytid] = dict(expiry=expiry, meta=streams) prune() return streams def select(slist, q=0, audio=False, m4a_ok=True, maxres=None): """ Select a stream from stream list. """ maxres = maxres or config.MAX_RES.get slist = slist['meta'] if isinstance(slist, dict) else slist def okres(x): """ Return True if resolution is within user specified maxres. """ return int(x['quality'].split("x")[1]) <= maxres def getq(x): """ Return height aspect of resolution, eg 640x480 => 480. """ return int(x['quality'].split("x")[1]) def getbitrate(x): """Return the bitrate of a stream.""" return x['rawbitrate'] if audio: streams = [x for x in slist if x['mtype'] == "audio"] if not m4a_ok: streams = [x for x in streams if not x['ext'] == "m4a"] if not config.AUDIO_FORMAT.get == "auto": if m4a_ok and config.AUDIO_FORMAT.get == "m4a": streams = [x for x in streams if x['ext'] == "m4a"] if config.AUDIO_FORMAT.get == "webm": streams = [x for x in streams if x['ext'] == "webm"] if not streams: streams = [x for x in slist if x['mtype'] == "audio"] streams = sorted(streams, key=getbitrate, reverse=True) else: streams = [x for x in slist if x['mtype'] == "video" and okres(x)] if not config.VIDEO_FORMAT.get == "auto": if config.VIDEO_FORMAT.get == "mp4": streams = [x for x in streams if x['ext'] == "mp4"] if config.VIDEO_FORMAT.get == "webm": streams = [x for x in streams if x['ext'] == "webm"] if config.VIDEO_FORMAT.get == "3gp": streams = [x for x in streams if x['ext'] == "3gp"] if not streams: streams = [x for x in slist if x['mtype'] == "video" and okres(x)] streams = sorted(streams, key=getq, reverse=True) util.dbg("select stream, q: %s, audio: %s, len: %s", q, audio, len(streams)) try: ret = streams[q] except IndexError: ret = streams[0] if q and len(streams) else None return ret def get_size(ytid, url, preloading=False): """ Get size of stream, try stream cache first. """ # try cached value stream = [x for x in g.streams[ytid]['meta'] if x['url'] == url][0] size = stream['size'] prefix = "preload: " if preloading else "" if not size == -1: util.dbg("%s%susing cached size: %s%s", c.g, prefix, size, c.w) else: screen.writestatus("Getting content length", mute=preloading) stream['size'] = _get_content_length(url, preloading=preloading) util.dbg("%s%s - content-length: %s%s", c.y, prefix, stream['size'], c.w) return stream['size'] def _get_content_length(url, preloading=False): """ Return content length of a url. """ prefix = "preload: " if preloading else "" util.dbg(c.y + prefix + "getting content-length header" + c.w) response = urlopen(url) headers = response.headers cl = headers['content-length'] return int(cl) def preload(song, delay=2, override=False): """ Get streams. """ args = (song, delay, override) t = threading.Thread(target=_preload, args=args) t.daemon = True t.start() def _preload(song, delay, override): """ Get streams (runs in separate thread). """ if g.preload_disabled: return ytid = song.ytid g.preloading.append(ytid) time.sleep(delay) video = config.SHOW_VIDEO.get video = True if override in ("fullscreen", "window", "forcevid") else video video = False if override == "audio" else video try: m4a = "mplayer" not in config.PLAYER.get streamlist = get(song) stream = select(streamlist, audio=not video, m4a_ok=m4a) if not stream and not video: # preload video stream, no audio available stream = select(streamlist, audio=False) get_size(ytid, stream['url'], preloading=True) except (ValueError, AttributeError, IOError) as e: import traceback traceback.print_exception(type(e), e, e.__traceback__) input("Press any key to continue...") util.dbg(e) # Fail silently on preload finally: g.preloading.remove(song.ytid) ================================================ FILE: mps_youtube/terminalsize.py ================================================ # https://gist.github.com/jtriley/1108174 """ Terminal Size. """ import os import sys import shlex import shutil import struct import platform import subprocess def get_terminal_size(): """ getTerminalSize(). - get width and height of console - works on linux,os x,windows,cygwin(windows) originally retrieved from: http://stackoverflow.com/questions/566746/how-to-get-console-window-width-in-python """ if sys.version_info >= (3,3): return shutil.get_terminal_size() current_os = platform.system() tuple_xy = None if current_os == 'Windows': tuple_xy = _get_terminal_size_windows() if tuple_xy is None: tuple_xy = _get_terminal_size_tput() # needed for window's python in cygwin's xterm! else: tuple_xy = _get_terminal_size_linux() if tuple_xy is None: tuple_xy = (80, 25) # default value return tuple_xy def _get_terminal_size_windows(): """ Get terminal size on MS Windows. """ # pylint: disable=R0914 # too many local variables try: from ctypes import windll, create_string_buffer # stdin handle is -10 # stdout handle is -11 # stderr handle is -12 h = windll.kernel32.GetStdHandle(-12) csbi = create_string_buffer(22) res = windll.kernel32.GetConsoleScreenBufferInfo(h, csbi) if res: (bufx, bufy, curx, cury, wattr, left, top, right, bottom, maxx, maxy) = struct.unpack("hhhhHhhhhhh", csbi.raw) sizex = right - left + 1 sizey = bottom - top + 1 return sizex, sizey except: pass def _get_terminal_size_tput(): """ Get terminal size using tput. """ # src: http://stackoverflow.com/questions/263890/ # how-do-i-find-the-width-height-of-a-terminal-window try: cols = int(subprocess.check_call(shlex.split('tput cols'))) rows = int(subprocess.check_call(shlex.split('tput lines'))) return (cols, rows) except: pass def _get_terminal_size_linux(): """ Get terminal size Linux. """ def ioctl_GWINSZ(fd): """ ioctl_GWINSZ. """ try: import fcntl import termios cr = struct.unpack('hh', fcntl.ioctl(fd, termios.TIOCGWINSZ, '1234')) return cr except: pass cr = ioctl_GWINSZ(0) or ioctl_GWINSZ(1) or ioctl_GWINSZ(2) if not cr or cr == (0, 0): try: fd = os.open(os.ctermid(), os.O_RDONLY) cr = ioctl_GWINSZ(fd) os.close(fd) except: pass if not cr or cr == (0, 0): try: cr = (os.environ['LINES'], os.environ['COLUMNS']) except: return return int(cr[1]), int(cr[0]) ================================================ FILE: mps_youtube/test/test_main.py ================================================ import unittest import pytest import mps_youtube.main as mps class TestMain(unittest.TestCase): def test_fmt_time(self): pytest.skip('main not have tested attribute') self.assertEqual(mps.fmt_time(0), '00:00') self.assertEqual(mps.fmt_time(59), '00:59') self.assertEqual(mps.fmt_time(100), '01:40') self.assertEqual(mps.fmt_time(1000), '16:40') self.assertEqual(mps.fmt_time(5000), '83:20') self.assertEqual(mps.fmt_time(6500), '1:48:20') def test_num_repr(self): pytest.skip('main not have tested attribute') self.assertEqual(mps.num_repr(0), '0') self.assertEqual(mps.num_repr(1001), '1001') self.assertEqual(mps.num_repr(10001), '10k') self.assertEqual(mps.num_repr(100001), '100k') self.assertEqual(mps.num_repr(1000001), '1.0m') self.assertEqual(mps.num_repr(10000001), '10m') self.assertEqual(mps.num_repr(100000001), '100m') self.assertEqual(mps.num_repr(1000000001), '1.0B') if __name__ == '__main__': unittest.main() ================================================ FILE: mps_youtube/test/test_mpris.py ================================================ #!/usr/bin/env python # -*- coding: utf-8 -*- from unittest.mock import MagicMock import dbus import pytest from mps_youtube import mpris def test_mprsi2controller_init(): assert mpris.Mpris2Controller() def test_mpris2mediaplayer_init(): bus = MagicMock() obj = mpris.Mpris2MediaPlayer(bus) assert obj v_obj = vars(obj) v_obj.pop("_locations_lock") # '_locations_lock': , assert vars(obj) == { "_connection": bus, "_fallback": False, "_locations": [(bus, "/org/mpris/MediaPlayer2", False)], "_name": None, "_object_path": "/org/mpris/MediaPlayer2", "fifo": None, "mpv": False, "properties": { "org.mpris.MediaPlayer2": { "read_only": { "CanQuit": False, "CanRaise": False, "CanSetFullscreen": False, "DesktopEntry": "mps-youtube", "HasTrackList": False, "Identity": "mps-youtube", "SupportedMimeTypes": dbus.Array([], signature=dbus.Signature("s")), "SupportedUriSchemes": dbus.Array( [], signature=dbus.Signature("s") ), }, "read_write": {"Fullscreen": False}, }, "org.mpris.MediaPlayer2.Player": { "read_only": { "CanControl": True, "CanGoNext": True, "CanGoPrevious": True, "CanPause": True, "CanPlay": True, "CanSeek": True, "MaximumRate": 1.0, "Metadata": { "mpris:trackid": dbus.ObjectPath( "/CurrentPlaylist/UnknownTrack", variant_level=1 ) }, "MinimumRate": 1.0, "PlaybackStatus": "Stopped", "Position": dbus.Int64(0), }, "read_write": {"Rate": 1.0, "Volume": 1.0}, }, }, "socket": None, } @pytest.mark.parametrize("val", (None, 0, 3, 5)) def test_mpris2mediaplayer_set_property_time_pos(val): obj = mpris.Mpris2MediaPlayer(MagicMock()) obj.Seeked = MagicMock() obj.setproperty("time-pos", val) exp_res = dbus.Int64(val * 10**6) if val else dbus.Int64(0) assert obj.properties[mpris.PLAYER_INTERFACE]["read_only"]["Position"] == exp_res seeked_call_args = None try: seeked_call_args = obj.Seeked.mock_calls[0].args except IndexError: pass if val and val >= 4: assert seeked_call_args == (exp_res,) else: assert seeked_call_args is None @pytest.mark.parametrize( "val1, val2", ( (0, 2), (2, 6), (2, 5), (2, 7), ), ) def test_mpris2mediaplayer_set_property_time_pos_seeked(val1, val2): obj = mpris.Mpris2MediaPlayer(MagicMock()) obj.Seeked = MagicMock() obj.setproperty("time-pos", val1) obj.setproperty("time-pos", val2) seeked_call_args = None try: seeked_call_args = obj.Seeked.mock_calls[0].args except IndexError: pass d2 = dbus.Int64(val2 * 10**6) if abs(d2 - dbus.Int64(val1 * 10**6)) >= 4 * 10**6: assert seeked_call_args == (d2,) else: assert seeked_call_args is None ================================================ FILE: mps_youtube/test/test_players_mplayer.py ================================================ #!/usr/bin/env python # -*- coding: utf-8 -*- from unittest import mock import pytest from mps_youtube.players import mplayer @pytest.mark.parametrize( "exename, exp_err", [ ("", (OSError, PermissionError)), ("mplayersomething", FileNotFoundError), ], ) def test_get_mplayer_version_no_mplayer(exename, exp_err): with pytest.raises(exp_err): mplayer._get_mplayer_version(exename) def test_get_mplayer_version_invalid_input(): with mock.patch("mps_youtube.players.mplayer.subprocess"), pytest.raises(TypeError): mplayer._get_mplayer_version(mock.MagicMock()) @pytest.mark.parametrize( "output, exp_res", [ ( "MPlayer Redxii-SVN-r38151-6.2.0 (x86_64) (C) 2000-2019 MPlayer Team...", 38151, ), ("MPlayer SVN-r38151-6.2.0 (x86_64) (C) 2000-2019 MPlayer Team...", 38151), ("MPlayer 1.4 (Debian), built with gcc-10 (C) 2000-2019 MPlayer Team", (1, 4)), ], ) def test_get_mplayer_version(output, exp_res): with mock.patch("mps_youtube.players.mplayer.subprocess") as m_subprocess: m_subprocess.check_output.return_value.decode.return_value = output assert mplayer._get_mplayer_version(mock.MagicMock()) == exp_res ================================================ FILE: mps_youtube/test/test_util.py ================================================ #!/usr/bin/env python # -*- coding: utf-8 -*- import pytest import mps_youtube.util as util @pytest.mark.parametrize( "num,t,exp_res", ( (0, "", ""), (0, None, ""), ), ) def test_uea_pad(num, t, exp_res): res = util.uea_pad(num, t) assert res == exp_res ================================================ FILE: mps_youtube/util.py ================================================ import collections import ctypes import json import logging import os import platform import re import subprocess import sys import time import unicodedata import urllib from datetime import datetime, timezone from importlib import import_module from . import c, description_parser, g, terminalsize from .playlist import Video macos = platform.system() == "Darwin" mswin = os.name == "nt" not_utf8_environment = mswin or ( "UTF-8" not in sys.stdout.encoding if sys.stdout.encoding else False ) XYTuple = collections.namedtuple('XYTuple', 'width height max_results') class IterSlicer(): """ Class that takes an iterable and allows slicing, loading from the iterable as needed.""" def __init__(self, iterable, length=None): self.ilist = [] self.iterable = iter(iterable) self.length = length if length is None: try: self.length = len(iterable) except TypeError: pass def __getitem__(self, sliced): if isinstance(sliced, slice): stop = sliced.stop else: stop = sliced # To get the last item in an iterable, must iterate over all items if (stop is None) or (stop < 0): stop = None while (stop is None) or (stop > len(self.ilist) - 1): try: self.ilist.append(next(self.iterable)) except StopIteration: break return self.ilist[sliced] def __len__(self): if self.length is None: self.length = len(self[:]) return self.length def has_exefile(filename): """ Check whether file exists in path and is executable. :param filename: name of executable :type filename: str :returns: Path to file or False if not found :rtype: str or False """ paths = [os.getcwd()] + os.environ.get("PATH", '').split(os.pathsep) paths = [i for i in paths if i] dbg("searching path for %s", filename) for path in paths: exepath = os.path.join(path, filename) if os.path.isfile(exepath): if os.access(exepath, os.X_OK): dbg("found at %s", exepath) return exepath return False def dbg(*args): """Emit a debug message.""" # Uses xenc to deal with UnicodeEncodeError when writing to terminal logging.debug(*(xenc(i) for i in args)) def utf8_replace(txt): """ Replace unsupported characters in unicode string. :param txt: text to filter :type txt: str :returns: Unicode text without any characters unsupported by locale :rtype: str """ sse = sys.stdout.encoding txt = str(txt) txt = txt.encode(sse, "replace").decode(sse) return txt def xenc(stuff): """ Replace unsupported characters. """ return utf8_replace(stuff) if not_utf8_environment else stuff def xprint(stuff, end=None): """ Compatible print. """ print(xenc(stuff), end=end) def mswinfn(filename): """ Fix filename for Windows. """ if mswin: filename = utf8_replace(filename) if not_utf8_environment else filename allowed = re.compile(r'[^\\/?*$\'"%&:<>|]') filename = "".join(x if allowed.match(x) else "_" for x in filename) return filename def sanitize_filename(filename, ignore_slashes=False): """ Sanitize filename """ if not ignore_slashes: filename = filename.replace('/', '-') if macos: filename = filename.replace(':', '_') if mswin: filename = utf8_replace(filename) if not_utf8_environment else filename allowed = re.compile(r'[^\\?*$\'"%&:<>|]') filename = "".join(x if allowed.match(x) else "_" for x in filename) return filename def set_window_title(title): """ Set terminal window title. """ if mswin: ctypes.windll.kernel32.SetConsoleTitleW(xenc(title)) else: sys.stdout.write(xenc('\x1b]2;' + title + '\x07')) def list_update(item, lst, remove=False): """ Add or remove item from list, checking first to avoid exceptions. """ if not remove and item not in lst: lst.append(item) elif remove and item in lst: lst.remove(item) def get_near_name(begin, items): """ Return the closest matching playlist name that starts with begin. """ for name in sorted(items): if name.lower().startswith(begin.lower()): return name return begin def F(key, nb=0, na=0, textlib=None): """Format text. :param nb: newline before :type nb: int :param na: newline after :type na: int :param textlib: the dictionary to use (defaults to g.text if not given) :type textlib: dict :returns: A string, potentially containing one or more %s :rtype: str """ textlib = textlib or g.text assert key in textlib text = textlib[key] percent_fmt = textlib.get(key + "_") if percent_fmt: text = re.sub(r"\*", r"%s", text) % percent_fmt text = text.replace("&&", "%s") return "\n" * nb + text + c.w + "\n" * na def get_pafy(item, force=False, callback=None): """ Get pafy object for an item. :param item: video to retrieve :type item: :class:`mps_youtube.playlist.Video` or str :param force: ignore cache and retrieve anyway :type force: bool :param callback: callpack to pass to pafy :type callback: func :rtype: Pafy """ if isinstance(item, Video): ytid = item.ytid else: ytid = item callback_fn = callback or (lambda x: None) cached = g.pafs.get(ytid) if not force and cached and cached.expiry > time.time(): dbg("get pafy cache hit for %s", cached.title) cached.fresh = False return cached else: try: p = None#pafy.new(ytid, callback=callback_fn) except IOError as e: if "pafy" in str(e): dbg(c.p + "retrying failed pafy get: " + ytid + c.w) p = None#pafy.new(ytid, callback=callback) else: raise g.pafs[ytid] = p p.fresh = True thread = "preload: " if not callback else "" dbg("%s%sgot new pafy object: %s%s" % (c.y, thread, p.title[:26], c.w)) dbg("%s%sgot new pafy object: %s%s" % (c.y, thread, p.videoid, c.w)) return p def getxy(): """ Get terminal size, terminal width and max-results. :rtype: :class:`XYTuple` """ # Import here to avoid circular dependency from . import config if g.detectable_size: x, y = terminalsize.get_terminal_size() max_results = y - 4 if y < 54 else 50 max_results = 1 if y <= 5 else max_results else: x, max_results = config.CONSOLE_WIDTH.get, config.MAX_RESULTS.get y = max_results + 4 return XYTuple(x, y, max_results) def fmt_time(seconds): """ Format number of seconds to %H:%M:%S. """ hms = time.strftime('%H:%M:%S', time.gmtime(int(seconds))) H, M, S = hms.split(":") if H == "00": hms = M + ":" + S elif H == "01" and int(M) < 40: hms = str(int(M) + 60) + ":" + S elif H.startswith("0"): hms = ":".join([H[1], M, S]) return hms def correct_truncate(text, max_len): """ Truncate a string taking into account East Asian width chars.""" str_len, out = 0, '' for c in text: str_len += real_len(c) if str_len <= max_len: out += c else: break return out def uea_pad(num, t, direction="<", notrunc=False): """ Right pad with spaces taking into account East Asian width chars. """ direction = direction.strip() or "<" t = ' '.join(str(t).split('\n')) # TODO: Find better way of dealing with this? if num <= 0: return '' if not notrunc: # Truncate to max of num characters t = correct_truncate(t, num) if real_len(t) < num: spaces = num - real_len(t) if direction == "<": t = t + (" " * spaces) elif direction == ">": t = (" " * spaces) + t elif direction == "^": right = False while real_len(t) < num: t = t + " " if right else " " + t right = not right return t def real_len(u, alt=False): """ Try to determine width of strings displayed with monospace font. """ if not isinstance(u, str): u = u.decode("utf8") u = xenc(u) # Handle replacements of unsuported characters ueaw = unicodedata.east_asian_width if alt: # widths = dict(W=2, F=2, A=1, N=0.75, H=0.5) # original widths = dict(N=.75, Na=1, W=2, F=2, A=1) else: widths = dict(W=2, F=2, A=1, N=1, H=0.5) return int(round(sum(widths.get(ueaw(char), 1) for char in u))) def yt_datetime(yt_date_time): """ Return a time object, locale formated date string and locale formatted time string. """ if yt_date_time is None: return ['Unknown', 'Unknown', 'Unknown'] time_obj = time.strptime(yt_date_time, "%Y-%m-%dT%H:%M:%SZ") locale_date = time.strftime("%x", time_obj) locale_time = time.strftime("%X", time_obj) # strip first two digits of four digit year short_date = re.sub(r"(\d\d\D\d\d\D)20(\d\d)$", r"\1\2", locale_date) return time_obj, short_date, locale_time def yt_datetime_local(yt_date_time): """ Return a datetime object, locale converted and formated date string and locale converted and formatted time string. """ datetime_obj = datetime.strptime(yt_date_time, "%Y-%m-%dT%H:%M:%SZ") datetime_obj = utc2local(datetime_obj) locale_date = datetime_obj.strftime("%x") locale_time = datetime_obj.strftime("%X") # strip first two digits of four digit year short_date = re.sub(r"(\d\d\D\d\d\D)20(\d\d)$", r"\1\2", locale_date) return datetime_obj, short_date, locale_time def utc2local(utc): return utc.replace(tzinfo=timezone.utc).astimezone(tz=None) def parse_multi(choice, end=None): """ Handle ranges like 5-9, 9-5, 5- and -5 with optional repetitions number [n] eg. 2-4[2] is the same as 2 3 4 2 3 4 and 3[4] is 3 3 3 3 Return list of ints. """ end = end or str(len(g.model)) pattern = r'(?=1.6.5 yt-dlp colorama ; platform_system=="Windows" ================================================ FILE: setup.cfg ================================================ [semantic_release] version_variable = setup.py:__version__ ================================================ FILE: setup.py ================================================ #!/usr/bin/python3 """ setup.py for yewtube. https://github.com/iamtalhaasghar/yewtube python setup.py sdist bdist_wheel """ import os import sys if sys.version_info < (3, 6): sys.exit("yewtube requires minimum python 3.6") from setuptools import setup with open("README.md", "r", encoding="utf-8") as fh: long_description = fh.read() with open('requirements.txt', 'r') as fh: requirements = fh.readlines() __version__ = "2.9.2" options = dict( name="yewtube", version=__version__, description="A Terminal based YouTube player and downloader. No Youtube API key required. Forked from mps-youtube", keywords=["video", "music", "audio", "youtube", "stream", "download"], author="talha_programmer", author_email="talhaasghar.contact@simplelogin.fr", url="https://github.com/iamtalhaasghar/yewtube", download_url="https://github.com/iamtalhaasghar/yewtube/releases", packages=['mps_youtube', 'mps_youtube.commands', 'mps_youtube.listview', 'mps_youtube.players'], entry_points={'console_scripts': ['yt = mps_youtube:main.main']}, python_requires='>=3.6', install_requires=requirements, extras_require={ "mpris": [ "dbus-python>=1.2.18", "PyGObject>=3.42.0", ], "docs": [ "mkdocs-gen-files>=0.3.4", "mkdocs-literate-nav>=0.4.1", "mkdocs-macros-plugin>=0.6.4", "mkdocs-material>=8.2.1", "mkdocstrings-python-legacy>=0.2.2", "mkdocstrings>=0.18.0", ], }, classifiers=[ "Topic :: Utilities", "Topic :: Internet :: WWW/HTTP", "Topic :: Multimedia :: Sound/Audio :: Players", "Topic :: Multimedia :: Video", "Environment :: Console", "Environment :: Win32 (MS Windows)", "Environment :: MacOS X", "Operating System :: POSIX :: Linux", "Operating System :: MacOS", "Operating System :: MacOS :: MacOS 9", "Operating System :: MacOS :: MacOS X", "Operating System :: Microsoft", "Operating System :: Microsoft :: Windows :: Windows 7", "Operating System :: Microsoft :: Windows :: Windows XP", "Operating System :: Microsoft :: Windows :: Windows Vista", "Intended Audience :: End Users/Desktop", "Programming Language :: Python", "Programming Language :: Python :: 3", "Programming Language :: Python :: 3.3", "Programming Language :: Python :: 3.4", "Programming Language :: Python :: 3 :: Only", "Development Status :: 5 - Production/Stable", "License :: OSI Approved :: GNU General Public License v3 (GPLv3)" ], options={ "py2exe": { "excludes": ("readline, win32api, win32con, dbus, gi," " urllib.unquote_plus, urllib.urlencode," " PyQt4, gtk"), "bundle_files": 1 } }, package_data={"": ["LICENSE", "README.md", "CHANGELOG.md"]}, long_description_content_type='text/markdown', long_description=long_description ) if sys.platform.startswith('linux'): # Install desktop file. Required for mpris on Ubuntu options['data_files'] = [('share/applications/', ['yewtube.desktop'])] if os.name == "nt": try: import py2exe # Only setting these when py2exe imports successfully prevents warnings # in easy_install options['console'] = ['yt'] options['zipfile'] = None except ImportError: pass setup(**options) ================================================ FILE: wheel_recipe.sh ================================================ rm -rf dist/ python -m build --sdist python -m build --wheel twine upload --verbose dist/* ================================================ FILE: yewtube.desktop ================================================ [Desktop Entry] Name=yewtube GenericName=Music Player Keywords=Audio;Song;Podcast;Playlist;youtube.com; Exec=yt %U Terminal=true Icon=terminal Type=Application Categories=AudioVideo;Audio;Player; StartupNotify=true NoDisplay=true ================================================ FILE: yt ================================================ #!/usr/bin/env python3 import mps_youtube.main mps_youtube.main.main()