Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make Varia compatible and able to sequential download hls videos from m3u8 links detected by extensions , just like IDA donwload manager , so we can playback temporary video and no more need to use extension or external service parser or web browser internal downloader, I found the ultimate secret how to make m3u8 links compatible either with manually add of m3u8 links in Varia or with other external download managers like IDA which is now able to download unlimited videoss from m3u8 links without being blocked, we hope Varia will apply this simple secret please to realize the dream and make detected m3u8 links compatible either with Varia or with external download managers please , and Add an independent standalone m3u8 parser like ytdlp-interface and Hitomi-Downloader in addition to the m3u8 parser ofyt-dlp to make Varia even more powerful universal donwloader and compatible with m3u8 links detected by video extensions please! #140

Open
trimechee opened this issue Dec 31, 2024 · 5 comments

Comments

@trimechee
Copy link

trimechee commented Dec 31, 2024

Hi, sometimes I encounter problems in downloading when I playback the temporary hls video downloaded by the famous download videos extensions like:

https://github.com/xifangczy/cat-catch

and

https://github.com/chandler-stimson/live-stream-downloader

this extension is not a downloader but can also detect m3u8 links of embedded hls videos for preview:

https://github.com/andy-portmen/open-in-vlc

and also these extensions are able to give us the m3u8 links of the embedded hls videos:

https://github.com/puemos/hls-downloader

https://fetchv.net/

https://github.com/54ac/stream-detector

https://cococut.net/

http://sniffertv.com/docs/
https://sniffertv.com/docs/

https://www.downloadhelper.net/

https://fdown.net/

https://9xbuddy.com/fr
https://9xbuddy.online/fr

https://mediatools.rndnm.com/howTo
https://mediatools.cc/hlsDownloader

https://www.startpage24.com/

https://m3u8.dev/
https://download.m3u8.dev/
https://beta.m3u8.dev/
https://m3u8play.dev/

i.e. the problems I encounter sometimes are the download does not finish or is deleted, web browser that does not close at the end of the download despite the auto close browser when donwload finish option is enabled....

I had the idea to use external downloaders to copy paste the m3u8 link given by these great extensions and put them in external donwload managers, like FDM, media-donwloader, jdownloader....but either it doesn't work and these download managers are unable to download hls m3u8 videos, or there is no sequential download and we can't playback temporary video because it's full of small fragments...

until this night, I decide to install IDA a famous Russian download manager because it's compatible with my indows 7 os 32 bits, and there the dream becomes true alhamdouilAllah, I copy the m3u8 link given by the extensions and I paste it into IDA: Internet Download Accelerator which can download the hls video sequentially and display the temporary video and I can playback temporary video! I set the number of threads = 1, and I enabled the option from the graphical interface "close IDA when download finish".....

so we hope please Varia will also be able to download hls videos if we copy and paste the m3u8 links given by the video downloaders extensions, so Varia will no longer need to develop a custom media detection extension, and we could download hls video and playback temporary video whose download should be sequential i.e. without displaying lots of small hls video fragments in the download folder in order to be able to playback temporary video, thank's!


Hi again, days ago I put a m3u8 link in IDA download manager able to download video from m3u8 links (number of threads=1) but an error message is displayed "download prohibited" in IDA, probably because I downloaded several videos previously.....

https://westbyte.com/ida/

I do some experiments and I find the ultimate secret so that external download managers like IDA can download videos from m3u8 links detected by Cat-Catch or Live-Stream-Downlader without the download in the download manager being blocked:

we copy the index v1a1.m3u8 link of the video given by Cat Catch or Live Stream Downloader and we open the network observer of the Bulk-media-downloader extension:

https://github.com/inbasic/bulk-media-downloader

then open a new tab of the web browser and paste the m3u8 link and click on the enter key, the m3u8 file is downloaded but little import, we go to network observer of the Bulk-media-downloader extension and we will see the m3u8 link and we select it and we click on external downloader/path of download manager /run

or another simpler method: before playing the video, open the network observer of the Bulk-media-downloader extension also capable of detecting m3u8 links and I play the video and I search and select the indexv1a1.m3u8 link, then at the very bottom I click on external downloader and I put the path of IDA.exe, there is a box to add arguments and the secret I put all the arguments... but we can skip the arguments because Bulk-media-downloader will ask us to install the extension: External Application Button:

https://github.com/andy-portmen/external-application-button

I install it and obviously I put in executable name the path of the IDA executable download manager and here is the secret of my sensational discovery: in the arguments box, I click on "reserved" and I click in drop-down menu on : entire url, page title, url host name, url path name, url hash tag, url protocol, selection text, download then insert local path, get referrer, get user agent, get cookie, extra info .

at the bottom of the page, I activate the option: "Allow other extensions to run native commands (use with caution) (you will get a confirmation box on every new requests)"

then I click on update application button .

and now, the dream becomes reality, the video of m3u8 link blocked in IDA download manager is no more blocked with this error message download prohibited.

now here is my request : please add an option to add all these vital arguments to the m3u8 link detected by Varia extension :

[HREF][TITLE][HOSTNAME][PATHNAME][HASH][PROTOCOL][SELECTIONTEXT][DOWNLOADED_PATH][REFERRER][USERAGENT][COOKIE][EXTRA]

so the m3u8 links of Varia will be compatible with the main core of Varia donwload manager or with others external download managers which will be able to avoid blocked downloads, thank you!

Sometimes unfortunately Varia extension cannot detect some links of embedded video hls, jwplayer, media videojs object, but the Live-stream-downloader extension can, so the dream please:

make m3u8 links compatible either with manually add of m3u8 links in Varia or with other external download managers which is now able to download unlimited videos from m3u8 links without being blocked, we hope Persepolis will apply my discovery consisting of these arguments of adding referrer, cookies, user agent...... please to realize the dream and make detected m3u8 links compatible either with Varia or with external download managers please !

we hope our beloved Varia will be able to detect m3u8 lins and make the detected links compatible with Varia or with other external download manager by adding all these arguments is the ultimate solution to fix downloads problems, thank you!

also, the new versions of the web browsers : catsxp, yandex, supermium, firefox .....no more display temporary video so we can't playback video while downloading, only custom chrome 130 for my windows 7 os still allows video downloaders extensions to display temporary video, and I fear chrome 131 or 132 will erase this important possibility of playback video while downloading useful for those who have weak connection and helps them to avoid waiting for download to finish, and using external download manager is the ultimate solution for playback temporary video while downloading, thanks !


Hi again , as I explained in this post :

#141

i discovered the ultimate secret to make m3u8 links detected by video downloaders extensions compatible with external download managers and thus avoid blocked download, my discovery basically consists in adding custom arguments to raw m3u8 links , arguments that can be found in the external-application-button and bulk-media-downloader extensions which are responsible for adding custom arguments (refererer, user agent, url path, extrainfo, cookies, title......) to external donwload managers who can now download video of m3u8 links without "download blocked" error message as it happened in IDA download manager after a few downloads before I discovered this vital trick....

and so my new request to the great Mr @giantpinkrobots : we know yt-dlp has an internal m3u8 parser but probably this m3u8 parser from yt-dlp does not support raw m3u8 links from platforms not supported by yt-dlp , so I think it will be better and awesome than our beloved life saver Varia add a standalone independent m3u8 parser like open source download manager "ytdlp-interface" and "Hitomi-Downloader" which integrate yt-dlp and also have a standalone m3u8 parser in addition to the m3u8 parser of yt-dlp to make our beloved Varia even more powerful universal downloader and compatible with m3u8 links detected by video extensions like cat catch and live stream donwloader please !

Thanks :)

https://github.com/ErrorFlynn/ytdlp-interface

and

https://github.com/KurtBestor/Hitomi-Downloader

@giantpinkrobots
Copy link
Owner

Hi. Please don't open multiple duplicate issues. If you manage to figure out additional details you should add them to the same open issue.

My current priority is to finalize yt-dlp support and publish the next version with video download support. We can revisit these improvements to the video download functionality afterwards.

@trimechee
Copy link
Author

Mr @giantpinkrobots , I did not post duplicates, please reread carefully what I posted, the first issue talks about implementing sequential download from m3u8 links, because download managers file centipede, neat download manager can detect and download m3u8 links but the temporary video in the download folder, there are lots of small hls video slices fragments so I can not playback temporary video while downloading hence my request,

in the second issue where you say it is a duplicate, I offer to varia a secret that I discovered recently, I explain the secret solution how to make m3u8 links compatible with external download managers like varia and how to avoid the blocking of videos download from m3u8 links where I detail step by step the secret procedure,

in the first issue, I had not yet discovered the secret how to make m3u8 links compatible with donwload manager , and my issue focuses on sequential donwload to make temporary video united without small fragments video slices able to be playback while donwloading ,

the second issue I explain my secret discovery how to make m3u8 links compatible with download managers like varia, and even if I talk about adding m3u8 links support in the first issue, in the second I explain my discovery how to make m3U8 links compatible with download manager, so they are totally different issues, I am surprised that you call them duplicate issue , the first issue, varia can invent its own solution to download m3u8 links, second issue I propose my own solution to download m3u8 links that varia can reject or not , third issue I propose to varia 2 opn source projects that have an internal independant m3u8 parser and varia can copy their code to facilitate the development task,

so in the third issue, I had the idea to submit to you the open source projects hitomi and ytdl inteface which have integrated an independent m3u8 parser in addition to yt-dlp so that varia may be inspired by these open source projects, each issue is different and has different links, different topics, requests.... thank you,

it took me a lot of research and effort to write all that, I think Mr @giantpinkrobots , to respect my work and research , and to improve Varia, it is better to reopen my issues, because it is the users of Varia who will be the losers if these improvements and the revolutionary effective technical solutions and requests that I propose in these issues are not integrated because you close these issues where i post efficient new diffeents solutions in each issues , thank you

@trimechee
Copy link
Author

trimechee commented Jan 5, 2025

@giantpinkrobots , at least keep this most important issue open please :

#141

and ok, ne problem, close the others issues if you think this is the right decison to take

@giantpinkrobots
Copy link
Owner

@giantpinkrobots , at least keep this most important issue open please :

#141

and ok, ne problem, close the others issues if you think this is the right decison to take

I will take into consideration of the things you've written in #141 and #142. I understand these issues are not talking about the exact same thing, that's not what I mean by duplicate. That's why I wrote "If you manage to figure out additional details you should add them to the same open issue." in my reply.

The reason I marked the other issues as duplicate is because all three issues are related to the same proposal of making Varia compatible with HTTP Live Streaming links. Your second issue talks about ways of achieving the idea you wrote in this issue. Your third issue gives examples of other projects that implemented this idea. These are not separate issues and you should post your discoveries and potential solutions under the first issue you've opened. They are all related to the same proposal. To add m3u8 link support would require making these links compatible with Varia (what you wrote about in #141), so no, they are not "totally different issues".

Now, you already opened separate issues for these separate posts so you don't need to post them again here, #141 and #142 are still there and I can reference them. But from now on please just post your findings and ideas under the first one you've created.

It's a bit early to add video download support from sites not supported by yt-dlp, as the yt-dlp integration support itself is still not finalized and published yet. But we can look at it later.

@trimechee
Copy link
Author

Ok Mr Giantpinkrobots ? no problem, thanks for these explanations !

indeed, I could have added my new discoveries to the same original issue by extending the title, the title, but I remind the original issue is already gigantic long without new discoveries, and the title is already very long where I already make a lot of requests, if I add things by editing my post, you can't see the new things .....

I admit I'm surprised because I thought you were going to blame me for not putting each request in an new issue, for example the issue you left open, I make minimum 2 requests: add support for M3u8 links and add sequential download to playback temporary hls video while downloading, that's why I avoided including new things ....

yes we understand supporting video download, it's a fairly complex task, Varia already offers us support for yt-dlp, thank you, that's the main and the most important feature !

anyway I'll try to copy and paste the content of the closed issues into the issue that remained open, thank you :)

@trimechee trimechee changed the title Make Varia compatible and able to sequential download hls videos from m3u8 links detected by extensions , just like IDA donwload manager , so we can playback temporary video and no more need to use extension or external service parser or web browser internal downloader Make Varia compatible and able to sequential download hls videos from m3u8 links detected by extensions , just like IDA donwload manager , so we can playback temporary video and no more need to use extension or external service parser or web browser internal downloader, I found the ultimate secret how to make m3u8 links compatible either with manually add of m3u8 links in Varia or with other external download managers like IDA which is now able to download unlimited videoss from m3u8 links without being blocked, we hope Varia will apply this simple secret please to realize the dream and make detected m3u8 links compatible either with Varia or with external download managers please , and Add an independent standalone m3u8 parser like ytdlp-interface and Hitomi-Downloader in addition to the m3u8 parser ofyt-dlp to make Varia even more powerful universal donwloader and compatible with m3u8 links detected by video extensions please! Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants