Commit Graph

2509 Commits

Author SHA1 Message Date
diogo e3df9f9ead use dig for getting the video index 2021-10-11 23:49:08 +02:00
diogo 62dc629337 linting 2021-10-11 23:49:08 +02:00
diogo dccdf38ce7 increase the max videos in a playlist 2021-10-11 23:49:07 +02:00
diogo 84124b837d use v1/next instead of searching for the continuation index 2021-10-11 23:49:07 +02:00
diogo 6176da3cbb linting 2021-10-11 23:46:23 +02:00
diogo 24bc3e2704 no need to normalize the offset 2021-10-11 23:45:22 +02:00
diogo 0a9e19646a pass the api/v1/playlists with videos before the offset 2021-10-11 23:43:41 +02:00
diogo 65e45c4079 linting 2021-10-11 23:30:49 +02:00
diogo 440105976f fix cases when high offset video from playlist has no offset in url 2021-10-11 23:30:49 +02:00
diogo 7eba7fbcc7 add index to playlist item 2021-10-11 23:30:49 +02:00
diogo d9bfb3d305 playlist starts at the offset 2021-10-11 23:30:49 +02:00
syeopite 4246c7a523 Extract image routes 2021-10-11 13:22:11 -07:00
Samantaz Fox 57ed047025 Add mising 'require' statement to 'invidious.cr' 2021-10-11 18:33:36 +02:00
Samantaz Fox bda3a26423 Move server structure to a separate file 2021-10-11 18:33:36 +02:00
Samantaz Fox 080d9a8dc7 move theme converter function to a separate file 2021-10-11 18:33:36 +02:00
Samantaz Fox 984a4acc7b Move user preferences structure to a separate file 2021-10-11 18:33:36 +02:00
syeopite b10f37bea9 Use kemal in production mode (#2455) 2021-10-11 14:42:22 +02:00
mastihios 0947c26612 Fix URL-encoding in href strings (#2460)
* hrefs: replace HTML.escape w/ URI.encode_www_form

* Fix search_query_encoded
2021-10-11 05:18:20 -07:00
Samantaz Fox c6f088d6ca Reduce refresh delay, increase backoff start duration 2021-10-08 18:39:02 +02:00
syeopite 21e29411af Fix extractor bugs (#2454)
* Add debug/trace logging to extract_items
* Handle invalid timestamps for livestreams extraction
* Make use of author_fallback in playlist extractor
* Don't use extract_text for video length extraction

The extract_text function attempts to extract from both the simpleText and
the runs route. This is typically what we'd want for text extraction as
it could appear in both locations. However, while this still holds true,
the thumbnailOverlayTimeStatusRenderer writes a numerical length (when
present on the video) to the simpleText route and uses runs for a
text overlay like "LIVE" or "PREMIERE".

Therefore, when a video has a text overlay instead of a numerical one,
Invidious still passes it onto decode_length_seconds, which obviously
raises since it cannot be converted into integers.

In the future, if more routes requires one text route over the other, we
should go ahead and add an argument to extract_text itself. Though for
now, this is sufficient.

* Handle unsupported "special" categories
2021-10-07 23:39:21 +02:00
Samantaz Fox adc12addfa Add config option to display source code URL in footer (#2450) 2021-10-07 13:53:12 +02:00
Samantaz Fox d806310665 Revert "Fix typo (#2456)" (#2457)
This reverts commit 4982bff74d.
2021-10-04 19:51:57 +02:00
Jorge Maldonado Ventura 4982bff74d Fix typo (#2456) 2021-10-04 17:47:57 +00:00
syeopite 81b12b8001 Add support to make invidious API-only via flag (#2363) 2021-10-02 20:04:02 +00:00
syeopite 3e781b7d13 Merge pull request #2443 from iv-org/syeopite-patch-1
Use make_client when querying instance api
2021-10-02 20:00:37 +00:00
syeopite 9c44e41a4c Merge pull request #2228 from syeopite/extract-items-overhaul
Overhaul extract_item(s) functions and add infrastructure for parsing YouTube categories
2021-10-02 20:00:16 +00:00
syeopite 73eabb6ca2 Actually fix lint 2021-10-02 08:53:58 -07:00
Samantaz Fox 5a52b4fe45 Fix lint 2021-10-02 17:41:25 +02:00
Samantaz Fox caa08a6379 Disable locales with less than 50% of strings translated 2021-10-02 17:38:06 +02:00
Samantaz Fox cd02078e26 Add Portuguese (pt) to locales
follow up to #2437
2021-10-02 17:19:28 +02:00
syeopite 77131cff91 Use make_client when querying instance api 2021-10-02 15:16:07 +00:00
mastihios 7b2aa5f98e add icon-buttons to playlist items (#2442) 2021-10-02 11:59:33 +00:00
syeopite 26b28cea49 Use break instead of short-circuit return 2021-10-01 05:39:23 -07:00
syeopite 23049e026f Improve readabltiy of SearchChannel auto-gen detect 2021-09-28 08:55:02 -07:00
syeopite 9ab242ca2e Optimize routing logic of extract_item(s) funcs 2021-09-28 08:50:23 -07:00
syeopite aa59925374 Rename get_browse_endpoint to get_browse_id 2021-09-28 08:39:00 -07:00
syeopite 43ea8fa706 Convert nil for AuthorFallback to empty strings 2021-09-28 08:25:03 -07:00
syeopite 6df85718e6 Apply suggestions from code review
Co-authored-by: Samantaz Fox <coding@samantaz.fr>
2021-09-28 15:23:36 +00:00
Samantaz Fox 9ba3e1cdb4 Decrease channel refresh frequency (1 min -> 1 h)
This is a temporary fix to reduce load on instances with many channels and avoid IP being flagged by Google.
2021-09-26 23:31:14 +02:00
syeopite b20f72b963 Use default timeout (5 seconds) for YT pool (#2430) 2021-09-26 23:03:45 +02:00
syeopite 092b8a4e52 Add documentation to extractors.cr 2021-09-24 21:07:07 -07:00
syeopite e5f07dedbf Typos and tiny styling changes 2021-09-24 21:07:07 -07:00
syeopite ca9eb0d539 Bountiful extractor changes
- Add extract_text to simplify extraction of InnerTube texts
- Add helper extractor methods to reduce repetition in parsing InnerTube
- Change [] more than 2 blocks long to use #dig or #dig?
- Remove useless ?.try blocks for items that always exists
- Add (some) documentation to VideoRendererParser
2021-09-24 21:07:07 -07:00
syeopite 142317c2be Overhaul extractors.cr to use modules 2021-09-24 21:07:07 -07:00
syeopite 3dea670091 Switch to structs in extractors.cr for performance 2021-09-24 21:07:07 -07:00
syeopite 8435e79913 Improve documentation for extract_item(s) funcs 2021-09-24 21:07:07 -07:00
syeopite 30e85b40f9 Fix extract_videos 2021-09-24 21:07:07 -07:00
syeopite be1a43a337 Manually extract category refactor from 1b569bbc99
Also fixes some errors caused by cherry-picking
2021-09-24 21:07:07 -07:00
syeopite abca8f7a7c Rename invidiousitems.cr 2021-09-24 21:07:07 -07:00
syeopite 7b60dac526 Add description_html field to Category
(cherry picked from commit aa8f15f795)
2021-09-24 21:07:07 -07:00