iSrSSKJrJrJr SSKJrJrJrJ r SSK r SSK r SSK r SSK r SSKrSSKrSr\S-r"S S \5r"S S \5r"S S\5r"SS\\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS\5r"SS 5r"S!S"\5r"S#S$\5r"S%S&\5r "S'S(\5r!"S)S*\5r""S+S,\5r#"S-S.\5r$"S/S05r%"S1S2\%5r&"S3S4\&5r'"S5S6\&5r("S7S8\&5r)"S9S:\&5r*"S;S<\&5r+"S=S>\&5r,"S?S@\&5r-"SASB\%5r.g)Cz&Extractors for https://www.tiktok.com/) ExtractorMessageDispatch)textutilytdl exceptionNz%(?:https?://)?(?:www\.)?tiktokv?\.comz /@([\w_.-]+)c\rSrSrSrSrSrSrSrSr Sr 0r 0r S r S rS r/4/S .S jjrSSjrSrSrSrSrSrSrSrSrSrSrSrSrSrg)TiktokExtractorz Base class for TikTok extractorstiktok)z {category}z{user}z<{id}{num:?_//>02} {title[b:150]}{file_id:? [/]/}.{extension}z{id}_{num}_{file_id}zhttps://www.tiktok.comz .tiktok.comc URSS5UlURSS5UlURSS5UlURSS5UlURSS5UlURS5=(d S Ul[R"UR 5Ul SUl SUl UR (aUR S :waUR SLd[UR [5(dS Ul1S kn[UR RS 55nUR!U5=(d SUl UR#U5=(d SUl ggg)NphotosTaudiovideoscoversF subtitlesz tiktok-rangeallASR>LCMTr,)configphotorvideocoverrrangerpredicate_range_parserange_predicatesubtitle_sourcessubtitle_langs isinstancestrsetsplit intersection difference)self known_sourcesfilterss H/app/mltbenv/lib/python3.13/site-packages/gallery_dl/extractor/tiktok.py_initTiktokExtractor._init"s$[[40 [[$/ [[40 [[51 [%8[[06B #99$**E!%" >>dnn5~~%Z-L-L!&/M$....s34G$1$>$>w$G$O4D !")"4"4]"C"KtD 6>c #D# UR5GHnURU5nURU5nSU;a(URUSS5nURU5nUSnURX1S5(dMsUSSnUR S5=n=(a US=(d S US 'UR US 5US 'S U;aSOSUS'US=pg[ RS U4v SnS U;aUR(aU(dSUS3nUS Sn [U S5HnupU SSSn [R"X5 URSU UU USRS5SU SU SS.5 [ RX4v Mp UR(aFSU;a@URS :XaS!nGOUR!U5=n (a[ RX4v GO_SU;Ga<UR"S :XaSnO@UR"(a/UR%U5=n (a[ RX4v US" UR&(a?UR)US5H)n [ RX4v UR&S#:wdM) O UR*(aUR-US5Hn [ RX4v M UR/S$S5 UR/S%S5 UR/S&S5 UR/S'S5 UR/S(S5 OUR0R3S)U5 U(aPU(d S*US+US3nURUSS US!:XaS,OS-USS SSS.. 5 [ RS/U-U4v GMGM g![4aXn UR0R7U 5 UR0R9S0XR:R<U 5 Sn A GMSn A ff=f7f)1Nzwebapp.video-detailz seo.abtest canonicalpostitemInfo itemStructauthoruniqueIdruser createTimedate imagePostimager post_typedescFzTikTok photo #idimagesrimageURLurlListr filename~ imageWidth imageHeight)typer=titlenumfile_idwidthheightmusicr r _fallbackrsubtitle_lang_idsubtitle_lang_codenamesubtitle_formatsubtitle_versionsubtitle_sourcez%s: Skipping postTikTok z #mp3mp4) rHr=rD extensionrIrJrKrLrMzytdl:z#%s: Failed to extract post (%s: %s))posts _sanitize_url_extract_rehydration_data_check_status_codegetparse_timestampr Directoryr enumeraternameext_from_urlupdate partitionUrlr_extract_audior_extract_videor_extract_coversr_extract_subtitlespoploginfo Exception tracebackerror __class____name__)r+ tiktok_urldata video_detailr4aoriginal_titlerI ytdl_mediaimg_listiimgurlexcs r.itemsTiktokExtractor.items:s**,J_ H!// ; 55jA(4"&!3!3\*;7"9J99*ED#$9: ..$&::#J/ =((8,,Q?!J-E2V #33D4FGV /:d/BG[!)-f5''T11" $&zz-&4T$ZL$AE#' #4X#>&/!&z __DEFAULT_SCOPE__zSolving JavaScript challengez%s: Failed to solve JavaScript challenge. If you keep encountering this issue, please try again with the --write-pages option and include the resulting page in your bug report/rz/%s: Failed to retrieve rehydration data (%s/%s)rretry)requesthistoryrzr AuthorizationErrorrcrextrr json_loadsKeyError ValueErrorrjrk_solve_challengerlrmwarning rpartition_retriessleep_timeout) r+rzadditional_keysrtrieshtmlchallenge_attemptresponserrkey assert_keyr{s r.r[)TiktokExtractor._extract_rehydration_datas!0 <<,##HLL(@#66%\\33C8;B:CC5G8 D## F-A E;6G8;FA5G87G8cXR;aURUnO3URUSS/S9nUSURU'USUlUSnURX1S5(d[R "US35eUHnX4nM U$![ aGnURRU5 [R "SUSRU55eSnAff=f)Nzwebapp.user-detailwebapp.app-contextrprofilez$: could not extract rehydration dataz+%s: could not extract rehydration data (%s), ) rehydration_data_cacher["rehydration_data_app_context_cacher\r ExtractionErrorrrjrmjoin)r+ profile_urlrrrrr{s r._extract_rehydration_data_user.TiktokExtractor._extract_rehydration_data_users 55 5..{;D11.0DE2D )*  ' ' 4)*  3,-D&&t)DD++-CDF F 9&y'  9 HH  s #++=TYY79 9 9s B C$ACC$cXUR(dURSS/5Ulgg)Nzhttps://www.tiktok.com/r)rr[r+s r.7_ensure_rehydration_data_app_context_cache_is_populatedGTiktokExtractor._ensure_rehydration_data_app_context_cache_is_populateds066..-0D/EG  37r1cP[R"[R"USS5SS5n[R"[R "US-5R 55n[R "USSS-5n[R"[R "USSS-55n[S 5HQnUR5nUR[U5R55 UR5U:XdMQ O [R "S 5e[R"[R"US S5SS5n[R"[R"US S5SS5n [R"[R"US S5SS5n UR"n [%[&R&"55S-n [R("[U5R5SS9R 5US'[R("[R*"U5R5SS9n UR,R/XR 5XS9 U (aUR,R/XXS9 gg)Nzid="cs">zclass=""z==vcrti@Bzfailed to find matching digestzid="wci"zid="rci"zid="rs"F)newlined)domainexpires)rrrrbinascii a2b_base64decodehashlibsha256r copyrbr&encodedigestr rcookies_domaininttime b2a_base64 json_dumpscookiesr')r+rcsrexpectedbaseidxtestwcircirsrrrs r.r TiktokExtractor._solve_challenges YYtyyy#6 3 G OOH//T :AAC D&&qvc{T'9:~~h11!C&+2DEF#C99;D KKC) *{{}( $ ++,LM Mii $ C8)SIii $ C8)SI YYtyyy#6 3 G$$diik"Q&$$SX__%6FMMO#    2 9 9 ;U K hhjI LL  SV  E r1cdURXSS5nUc[R"US35eU$)NzMS4wLjABAAAA[\w-]{32,64}secUidz%: unable to extract secondary user ID _extract_idr AbortExtraction)r+r user_namesec_uids r._extract_sec_uid TiktokExtractor._extract_sec_uidsE"" $?K ?+++BCE Er1cdURXSS5nUc[R"US35eU$)Nz[0-9]+r@z: unable to extract user IDr)r+rr author_ids r._extract_author_id"TiktokExtractor._extract_author_idsC$$ It5  +++89; ;r1c[R"U5RnU"U5bU$URUSSU45nU"U5cS$U$)NuserInfor9)rre fullmatchr)r+rrregexid_keymatchr@s r.rTiktokExtractor._extract_id%sX((   '   0 0 *ff57Ry(t0b0r1c USnURU5nU(d[R"USS35eUSn[R"XA5 UR USSSSUS=(d SUS3UR S5SS UR S 5UR S 5S . 5 US (dUR SS5US 'U$)Nrr@zA: Failed to extract video URLs. You may need cookies to continue.r rr?zTikTok video #durationrrLrM) rOrHr=rIrrJrKrLrMrXformatrW)_extract_video_urlsr rrrarbr])r+r4rurlsrzs r.rfTiktokExtractor._extract_video1sW ''.++:,456 61g c( ab fF>$t*)F:.7+8,  K % (E :D  r1cFSU;aUSn[U[5(dU/n0nUHnUSn[R"UR S55n[R"UR S55nXg-nX;aX8==UR S5- ss'MxUR S5R 5X8'M [U5n U R SS9 U VV s/sHoUHoPM M n nn O/n SU;aU RUS5 U $s sn nf) N bitrateInfoPlayAddrWidthHeightUrlListTreverseplayAddr)r%listr parse_intr]rsortappend) r+r bitrate_info bitrate_urls video_info play_addrrLrMsizesizesrzrs r.r#TiktokExtractor._extract_video_urlsJs E ! /LlD11 ,~ L* &z2 y}}W'=> h(?@~' &)-- *BB&)2y)A)F)F)HL&+&E JJtJ $$)HED$5GcC5GCEDHDD   KKj) * Is$Dc USnUSn[R"X15 URSSUS=(d SUS3URS5SURS5SSS .5 US (dS US 'U$) NrNplayUrlrr?zTikTok audio #r@rr )rHr=rIrrJrKrLrMrXrV)rrarbr])r+r4rrzs r.reTiktokExtractor._extract_audioisW I c(  fF>$t*)F:.4  K %D  r1c # # XnSHvnURU5=n(dM[R"XQ5 URSSUUS=(d SUSUS3URS5S US S S . 5 Uv Mx g7f) N) thumbnailr originCover dynamicCoverrjpgr?rUz cover #r@rr ) rHrXr=rIrrJrKrLrM)r]rrarb)r+r4rHmediacover_idrzs r.rgTiktokExtractor._extract_covers{s MHii))s)%%c0 !(!&!$!%f"F#*4&d !E!&:!6!"!)!"!"   Ns BABc#h# XnURSLnURSLnURSS5GHwnURS5nURS5nURS5n URS5n URS5n U=(a XR;n U=(a XR;n U (dU (dU(dU(aMURS5=n(dM[R"X5 US (dCUS S US U S U 3US 'U R 5US 'US S :XaSUS 'OUS S:XaSUS 'UR SSUS=(d SUSUS 3URS5SUS US U S U S U 3 UUU U U SSS. 5 Uv GMz g7f)N subtitleInfos LanguageIDLanguageCodeNameFormatVersionSourcerdrDr@_rXwebvttvttcreator_captionjsonsubtitler?rUz subtitle #rr ) rHr=rIrrJrKrPrQrRrSrTrLrM)r#r$r]rralowerrb)r+r4rHrsources_filteredlangs_filteredr sub_lang_idsub_lang_codename sub_format sub_version sub_source sources_match langs_matchrzs r.rh"TiktokExtractor._extract_subtitless 00<,,D8 /26H",,|4K ( -? @ !h/J",,y1K!h/J-4333 (9!%8%88 !%ll5))s)%%c0J'+/:,a8I7J!+6-q )FD$(2(8(8(:D%K(H4,1[)k*.??,2[) .8.2V @!${4:,?.3ii .C./&-q):(;1ZL&-q 6.9.?.8.9.8././#& k7s C.F24B>F2c.URS5nU(dgUS:XaXURU5nUcURRSUU5 gUS:agURRSUU5 gUS:XaURRSU5 gUS :XaURRS X#5 gUS :XaURRS U5 gURRS X$URS5=(d S5 g)N statusCodeTi'z$%s: Login required to access this %sr zJ%s: Login required to access this %s, or this profile has no videos postedi'z#%s: User account could not be foundi'z%s: Requested %s not availablei'z?%s: Region locked - Try downloading with a VPN/proxy connectionz)%s: Received unknown error code %s ('%s') statusMsgrF)r]%_extract_video_count_from_user_detailrjrn)r+detailrz type_of_urlstatus video_counts r.r\"TiktokExtractor._check_status_codesL) U?DDVLK"Es*,&#q >?B*,u_ HHNN@# Fu_ HHNN;S Nu_ HHNN236 8  HHNN;VZZ 4: <r1cURS5nU(dgURS5=(d URS5n[US5$![[4a gf=f)NrstatsstatsV2 videoCount)r]rrr)r+r& user_infor,s r.r%5TiktokExtractor._extract_video_count_from_user_details`JJz*  g&B)-- *B u\*+ +*%  s AA%$A%) rrrr r"rr$r#rrN)r )rp __module__ __qualname____firstlineno____doc__category directory_fmt filename_fmt archive_fmtrootrrrr/r|rZr[rrrrrrrfrrergrhr\r%__static_attributes__r r1r.r r s*H,MF(K #D"N)+&L0aHFM>@6+-6p4G F: 12>$(:x#J r1r c0\rSrSrSrSr\S-rSrSr Sr g) TiktokPostExtractoriz+Extract a single video or photo TikTok linkr4z+/(?:@([\w_.-]*)|share)/(?:phot|vide)o/(\d+)z-https://www.tiktok.com/@USER/photo/1234567890c`URupURSU=(d SSU3nUS0$)N/@rr)groupsr9)r+r9post_idrzs r.rYTiktokPostExtractor.postss5  2djb\ :T{r1r N) rpr1r2r3r4 subcategory BASE_PATTERNpatternexamplerYr:r r1r.r<r<s5KKKG=Gr1r<c*\rSrSrSrSrSrSrSrSr g) TiktokVmpostExtractori z.Extract a single video or photo TikTok VM linkvmpostzP(?:https?://)?(?:(?:v[mt]\.)?tiktok\.com|(?:www\.)?tiktok\.com/t)/(?!@)([^/?#]+)zhttps://vm.tiktok.com/1a2B3c4E5c#*# [R"UR5nSS0nURXSS9nU(a[ U5S::a[ R "S5eS[0n[RURS5SU4v g7f) Nz User-Agentzfacebookexternalhit/1.1r4)headersnotfound _extractorrr ) rrrzrequest_locationlenr NotFoundErrorr<rQueuerc)r+rzrJrrs r.r|TiktokVmpostExtractor.itemss%%dhh/!:;##C6#Jc#h"n))&1 112mmS]]3/2D88sBBr N) rpr1r2r3r4rBrDrEr|r:r r1r.rGrG s8K#G0G 9r1rGc,\rSrSrSr\S-rSrSrSr g)TiktokUserExtractoriz#Extractor for a TikTok user profilez /?(?:$|\?|#)zhttps://www.tiktok.com/@USERc URSURSS3nUR[US-4[US-4[ US-4[ US-4[US-4[US -44S 5$) Nr>r ravatarrYrepostsstorieslikessaved)rVrY) r9r?_dispatch_extractorsTiktokAvatarExtractorTiktokPostsExtractorTiktokRepostsExtractorTiktokStoriesExtractorTiktokLikesExtractorTiktokSavedExtractor)r+rs r.r|TiktokUserExtractor.items#s))Bt{{1~.a0(( "TH_ 5 !TG^ 4 #TI%5 6 #TI%5 6 !TG^ 4 !TG^ 4 *    r1r N) rpr1r2r3r4 USER_PATTERNrDrEr|r:r r1r.rTrTs-_,G,G  r1rTc,\rSrSrSr\S-rSrSrSr g)r\i/rVz/avatarz#https://www.tiktok.com/@USER/avatarc## URSnURSU3nURUS5nURSU5US'URS5=(d URS5=(d USn[R "XCR 55nURS S US-US US RS 5SSS.5 [RSU4v [RXE4v g7f)Nr r>)rr9r8r9 avatarLarger avatarMedium avatarThumbrV@r@rDrE)rHrIr@rKrJr) r?r9rr]rrarrbrcrr_rd)r+rrrr avatar_urlrVs r.r|TiktokAvatarExtractor.items4sKKN  2i[1 22 -/xx I6V XXn-#.1I#M" &&z99;? T&\)Dzj)33C8;   V++kk:--sDDr N) rpr1r2r3rBrcrDrEr|r:r r1r.r\r\/sKZ'G3G.r1r\cD\rSrSrSr\S-rSrSrSr Sr Sr S r S r g ) r]iJrYz/postsz"https://www.tiktok.com/@USER/postscURSnURSU3n[UR5UlUR SS5(a<UR U5=n(aU$SnURRSUS35 OSnURX!5=n(aU$SU3nU(dUS - nURRU5 g ) Nr r>r FTzCould not extract TikTok user z= via yt-dlp or youtube-dl, attempting the extraction directlyz-Could not extract any posts from TikTok user zM, try extracting post information using yt-dlp with the -o ytdl=true argumentr ) r?r9boolruser_provided_cookiesr_extract_posts_ytdlrjr_extract_posts_api)r+rrrYr messages r.rYTiktokPostsExtractor.postsOsKKN  2i[1 %)$,,%7" ;;vu % %00==u= D HH  = ){+BB CD++KC C5 CLAK! ? ?G !r1c [R"URS55nSSS.nURURUR(+[UR5S.nUR(aURRS5US '[R "X XT5nUR"(a1UR$R&nUR"H nU"U5 M Un U R)XR+S 5S 0S5n U S V s/sHn U S R-S5SPM sn sSSS5 $![[4aNnUR R S[USS55 UR RU5 /sSnA$SnAff=fs sn f!,(df  g=f)NmodulezCannot import module '%s'namerT) extract_flatignore_no_formats_error)retriessocket_timeoutnocheckcertificateplaylist_itemshttpproxy TikTokUserFentriesrzrr )r import_moduler ImportError SyntaxErrorrjrngetattrrmrr_verifyr&r _proxiesr]construct_YoutubeDLr cookiejar set_cookie_YoutubeDL__extract_infoget_info_extractorrc) r+rrur{ extr_opts user_opts ytdl_instancercookieydl info_dictrs r.rp(TiktokPostsExtractor._extract_posts_ytdlks '' H(=>F(,'+ (,}}'+}}+/<<'7'*4::  ==!%!2!26!:Ig 00 )0  <<&00;;J,,6"'c4433LAr4!I "+9!57!5%L**3/2!57 ]9[)  HHNN6"33 5 HH  s #I  D7 ]s<%E 3+F1!F,?F1 F)AF$F)$F),F11 F?cURS5=(d SUlURS;aSUlURX5nURS:XaURXUR5$UR (d8UR RSU5 URXUR5$URXUR5nU(aU$UR RSU5 URXUR5$![a%nUR RU5 SnANbSnAff=f)Nz order-postsr?)r?ascrpopularz%s: no cookies have been provided so the order-posts option will not take effect. You must provide cookies in order to extract a profile's posts in non-descending orderz%s: failed to extract user posts using post/item_list (make sure you provide valid cookies). Attempting with legacy creator/item_list endpoint that does not support post ordering) r post_orderr_extract_posts_api_legacyr"rorjr_extract_posts_api_orderrlrmrn)r+rrrrr{s r.rq'TiktokPostsExtractor._extract_posts_apis?++m4> ??"G G$DO'' ? ??f $11d&:&:< <)) HH    11d&:&:< < $00d&:&:$D E &EE cSnURS;aSnOURS;aSnUUSSS.n[U5nURXU5(d/$URXRUR UR 5$) N0)rr2)r115false)rpost_item_list_request_typecountneedPinnedItemIds)rTiktokPostItemListRequestexecute generate_urlsrrr)r+rrr"rquery_parametersrs r.r-TiktokPostsExtractor._extract_posts_api_orders&)# ??0 0*- ' __ +*- '+F!(   ,O<t2BCCI$$[**djj%)ZZ1 1r1cUSSS.n[U5nURXU5 URXRURUR 5$)Nrr)rrHr)TiktokCreatorItemListRequestrrrrr)r+rrr"rrs r.r.TiktokPostsExtractor._extract_posts_api_legacysT  /?+;<$$[**djj%)ZZ1 1r1)rroN)rpr1r2r3rBrcrDrErYrprqrrr:r r1r.r]r]Js1KY&G2G8&7P&8P1$ 1r1r]c,\rSrSrSr\S-rSrSrSr g)r^irWz/repostsz$https://www.tiktok.com/@USER/repostscURSnURSU3nURX!5SSSS.n[UR5nUR XU5 UR X RURUR5$Nr r>rrr)rrrr) r?r9rTiktokRepostItemListRequestr"rrrrrr+rrrrs r.rYTiktokRepostsExtractor.postssKKN  2i[1 ++KC+.!(   .d.B.BC+;<$$[**djj%)ZZ1 1r1r N rpr1r2r3rBrcrDrErYr:r r1r.r^r^sK[(G4G 1r1r^c,\rSrSrSr\S-rSrSrSr g)r_irXz/storiesz$https://www.tiktok.com/@USER/storiescURSnURSU3nURX!5SSS.n[5nUR XU5 UR X R URUR5$)Nr r>r5)authorId loadBackwardr) r?r9rTiktokStoryItemListRequestrrrrrrs r.rYTiktokStoriesExtractor.postssKKN  2i[1 // G#  -.+;<$$[**djj%)ZZ1 1r1r Nrr r1r.r_r_sK[(G4G 1r1r_c,\rSrSrSr\S-rSrSrSr g)r`irYz /like[sd]z"https://www.tiktok.com/@USER/likedcURSnURSU3nURX!5SSSS.n[UR5nUR XU5 UR X RURUR5$r) r?r9rTiktokFavoriteItemListRequestr"rrrrrrs r.rYTiktokLikesExtractor.postssKKN  2i[1 ++KC+.!(   00D0DE+;<$$[**djj%)ZZ1 1r1r Nrr r1r.r`r`sK\)G2G 1r1r`c,\rSrSrSr\S-rSrSrSr g)rairZz/savedz"https://www.tiktok.com/@USER/savedcURSnURSU3nURX!5SSSS.n[UR5nUR XU5 UR X RURUR5$r) r?r9rTiktokSavedPostItemListRequestr"rrrrrrs r.rYTiktokSavedExtractor.postssKKN  2i[1 ++KC+.!(   11E1EF+;<$$[**djj%)ZZ1 1r1r Nrr r1r.rarasKY&G2G 1r1rac6\rSrSrSrSr\S3rSrSr Sr Sr g ) TiktokFollowingExtractori,z9Extract all of the stories of all of the users you follow followingz /followingz https://www.tiktok.com/followingc2SSS.n[5nURXRU5(d&URR SUR5 UR 5n[ U5S:Xa&URRSUR5 0n[[ U5S- S-S-5GHKnUS-nX5S-US-n[ U5S:XaURUSS5(aM@URRS US RUVV s/sHupURU5(aMU PM! sn n55 UVV s/sH.upURU5(aMURX5PM0 n nn S RU 5S S .n[5nURUSU3U5 URUR SURUR UR"55 GMN U$s sn nfs sn nf)zMAttempt to extract all of the stories of all of the accounts the user follows3r)storyFeedScenerzN%s: could not extract follower list, make sure you are using logged-in cookiesr z0%s: No followers with stories could be extractedr z!TikTok user stories, batch %d: %srrr) authorIdsstoryCallScenezBatch zhttps://www.tiktok.com/@_)TiktokStoryUserListRequestrrzrjrnrrOrr _is_current_userrkrrTiktokStoryBatchItemListRequestrbrrr) r+rrusersrb batch_number user_batchuser_idr author_idss r.rYTiktokFollowingExtractor.posts2s " -.tXX/?@@ HHNN=>Bhh H%%' u:? HH  )*.(( 4 E Q2-12Aq5LtLO4J :!#((Aq)9:: HHMM=|))%/%3%/6JW7;7L7L)082&1%/%34 57AA6@2g!%!6!6w!?H$11+G6@ A!XXj1"%  67G OODF<."9;K L NN7001L15TZZ15= >A3H/%3As"H H H9HcUR5 SUR;agSURS;agURSSU:H$)Nr9Fuid)rr)r+rs r.r)TiktokFollowingExtractor._is_current_usernsU DDF @@ @ ??G G66v>uE  r1r N) rpr1r2r3r4rBrCrDrErYrr:r r1r.rr,s&CKz*G0G:xr1rc \rSrSrSrSrSrg)TiktokPaginationCursorixcg)ztMust return the page the cursor is currently pointing to. Returns ------- int The current value of the cursor. r r rs r. current_page#TiktokPaginationCursor.current_pageysr1cg)a?Must progress the cursor to the next page. Parameters ---------- data : dict The response of the most recent request. query_parameters : dict All of the query parameters used for the most recent request. Returns ------- bool True if the cursor detects that we've reached the end, False otherwise. Tr r+rrrs r. next_page TiktokPaginationCursor.next_pages$r1r N)rpr1r2r3rrr:r r1r.rrxs  r1rcF^\rSrSrSSSS.U4SjjrSrSrS rS rU=r $) TiktokTimeCursoriThasMorecursorrhas_more_attributecursor_attributecT>[TU]5 SUlXlX lX0lgNr )super__init__rr has_more_key cursor_key)r+rrrros r.rTiktokTimeCursor.__init__s'   .*r1cUR$Nrrs r.rTiktokTimeCursor.current_page {{r1cURS:Hn[URURS55nU(+nU(drUR(a(X@R:dU(aUR U5nOVUR(d'X@R:dU(aUR U5nOU(a[ R"S5eX@lURURS5(+$)Nr zCould not extract next cursorF) rrr]rrfallback_cursorr rr)r+rrrskip_fallback_logic new_cursor no_cursors r.rTiktokTimeCursor.next_pages"kkQ.$//156 "N "||kk!9Y!11$7 \\zKK'?9!11$7 ++,KL L 88D--u555r1c[USSS5S-$![a SUR(aSOS-s$f=f)NitemListr: $r)rrlrr+rrs r.r TiktokTimeCursor.fallback_cursorsK @tJ'+L9:TA A @!4<>)rrrr) rpr1r2r3rrrrr: __classcell__ros@r.rrs+"&9"*++6 @@r1rc(^\rSrSrU4SjrSrU=r$)TiktokForwardTimeCursoric >[TU]SS9 g)NFrrrr+ros r.r TiktokForwardTimeCursor.__init__s 'r1r rpr1r2r3rr:rrs@r.rrs ((r1rc(^\rSrSrU4SjrSrU=r$)TiktokBackwardTimeCursoric >[TU]SS9 gNTrrrs r.r!TiktokBackwardTimeCursor.__init__ &r1r rrs@r.r r s ''r1r c.^\rSrSrU4SjrSrSrU=r$)TiktokPopularTimeCursoric >[TU]SS9 gr rrs r.r TiktokPopularTimeCursor.__init__rr1cg)Ni[TU]SSSS9 g)NF HasMoreAfter MaxCursorrrrs r.rTiktokStoryTimeCursor.__init__s >*5  7r1r rrs@r.rrs 77r1rc4^\rSrSrU4SjrSrSrSrU=r$)TiktokLegacyTimeCursoricn>[TU]5 [[R"55S-Ulg)Nr)rrrrrrs r.rTiktokLegacyTimeCursor.__init__s% $))+&- r1cUR$rrrs r.r#TiktokLegacyTimeCursor.current_pagerr1c2URn[USSS5S-UlUR(aX0R:Xa US- UlURS5nURS:=(d U(+$![a SUlNkf=f) Nrrr:rr rhasMorePreviousl4[TU]5 SUlXlgr)rrrr()r+r(ros r.rTiktokItemCursor.__init__s   r1cUR$rrrs r.rTiktokItemCursor.current_pagerr1cU=R[URURS55- slSU;a US(+$URSS5(+$)Nr rrF)rrOr]r(rs r.rTiktokItemCursor.next_pagesO s488DMM2677  I& &88NE222r1)rr()r) rpr1r2r3r&rrrr:rrs@r.r'r's#!!! 33r1r'cV\rSrSrSrSrSrSrSrSr Sr S r S r S r S rS rg)TiktokPaginationRequestic>XlUR5 0Ulgr)endpoint_regenerate_device_idr|)r+r2s r.r TiktokPaginationRequest.__init__s  ""$ r1c FURU5 0UlURU5nU(aU"5OSn[R"SS9GHn[ UR5nUR RSUURXgUS:XaSOS5 SnURUUU5upURU 5n URX[URR55[U R555 URRU 5 U(a6URU U 5n UR!X5n U (dU (a gGM g g!["anXR$:aHUR R'S X RU5 UR R)U5 SnA g US- nUR R+S X RU5 UR-UR.S 5 SnAOSnAff=fGM) aPerforms requests until all pages have been retrieved. The items retrieved from this request are stored in self.items. Each call to execute() will clear the previous value of self.items. Usually extractors want a simple list of URLs. For this, each request subtype is to implement generate_urls(). Parameters ---------- extractor : TiktokExtractor The TikTok extractor performing the request. url : str The URL associated with this request for logging purposes. query_parameters : dict[str, str] The query parameters to apply to this request. Returns ------- bool True if the request was performed successfully and all items were retrieved, False if no items or only some items could be retrieved. Nr)startz%%s: retrieving %s page %d (%d item%s)rsr Tz!%s: failed to retrieve %s page %dFr)validate_query_parametersr| cursor_type itertoolsrrOrjrkr2 _request_data extract_items_detect_duplicate_pagesr'keysrbr exit_earlyrlrrnrmrrr)r+ extractorrzrr9rpage item_countrrrfinal_parametersincoming_itemsfinal_page_reachedr?r{s r.rTiktokPaginationRequest.execute s6 &&'78 &&'78 "-4OO!,DTZZJ MM  F#}}d%/1_r# ?EA-1-?-?!(.*D &*%7%7%=N0014TZZ__5F1G14^5H5H5J1KMJJ%%n5-3-=-=d>N.P*%)__Y%D %);#' $9-:! A 2 22! ++-125}}dL! //4$QJEMM))*M*-}}dDOOI$6$6@@ A/s!CE** H4AH AHHcSU;de[US5[LdeUSR5(deUSS:wdeg)aUsed to validate the given parameters for this type of pagination request. For developer purposes only. You should call super().validate_query_parameters() for most requests as they will usually have a count parameter. Parameters ---------- query_parameters : dict[str, str] The query parameters to validate. Raises ------- AssertionError If mandatory query parameters are not given, or they are given in the wrong format. rrN)rHr&isdigitr+rs r.r81TiktokPaginationRequest.validate_query_parametersRsY(****$W-.#555(002222(C///r1cg)aUsed to determine which type of cursor to use for this request, if any. Parameters ---------- query_parameters : dict[str, str] The query parameters given to the execute() call. Returns ------- Type[TiktokPaginationCursor] | None The type of cursor to use, if any. Nr rIs r.r9#TiktokPaginationRequest.cursor_typeksr1c0$)aUsed to extract data from the response of a request. Parameters ---------- data : dict The data given by TikTok. Returns ------- dict Each item from the response data, keyed on a unique ID. Raises ------ Exception If items could not be extracted. r rs r.r<%TiktokPaginationRequest.extract_items|s & r1cg)arUsed to determine if we should exit early from the request. You have access to the items extracted so far (self.items). Parameters ---------- extractor : TiktokExtractor The extractor making the requests. url : str The URL associated with the executing request for logging purposes. Returns ------- bool True if we should exit early, False otherwise. Fr r+r@rzs r.r?"TiktokPaginationRequest.exit_earlys&r1c/$)aUsed to convert the items retrieved from the request into a list of URLs. Returns ------- dict Ideally one URL for each item, that points to a video detail object, although subclasses are permitted to return a list or dict of any format they wish. r rs r.r%TiktokPaginationRequest.generate_urlss  r1cN[[R"SS55Ulg)Nl*{Y2$lB2n?-)r&randomrandint device_idrs r.r3-TiktokPaginationRequest._regenerate_device_ids!V^^ %'@BCr1c SnURUU5upVURU5n[R"UR5U4$![ a* US:XaeUR RS5 US- nOf=fM)Nr rz5Could not decode response for this page, trying again)_build_api_request_urlrrrrrrjr)r+r@rrryrzrCrs r.r;%TiktokPaginationRequest._request_datas (,(C(C$)%%,,S1 68HII a< %%K1   sAA 1B?Bc0SS_SS_SS_SS_S S _S S _S S_SS_SS_SS _SUR_SS_SS _SS_SS_SS_SS _SSSSS S!S"S#S$SR[R"S%S&S'95-SS(. EnU(a%[ [ UR 555US)'UR5H upEUX4'M [R"U5nS*URS+U3U4$),Naid1988 app_languageenapp_name tiktok_webbrowser_languagezen-US browser_nameMozillabrowser_onlinetruebrowser_platformWin32browser_versionz 5.0 (Windows)channelcookie_enabledrWdevice_platformweb_pc focus_state from_pager9 history_lenr is_fullscreenris_page_visiblewindowsrUS10801920UTCverify_0123456789abcdef)k) languageospriority_regionrefererregion screen_height screen_widthtz_nameverifyFpwebcast_languagerzhttps://www.tiktok.com/api/z/?) rWrrUchoicesr&rrr|r build_queryr2)r+rextra_parametersrrvalue query_strs r.rZ.TiktokPaginationRequest._build_api_request_urls 6 D       I  f       |  f    x  6    3 W! " v# $!#"!BGGFNN"a-)%** $9 < ),S1D1D1F-G)H X &*002JC',g  !3$$%56 -dmm_BykJ " "r1cU(aHXC:XaBUR5 URRSU5 [R"S5egg)NzU%s: TikTok API keeps sending the same page. Taking measures to avoid an infinite loopz&TikTok API keeps sending the same page)r3rjrr r)r+r@rzseen_ids incoming_idss r.r=/TiktokPaginationRequest._detect_duplicate_pagessQ L4  & & ( MM ! !#)*- /++8: :5 EAN02"** C(&"P :r1r0c@^\rSrSrU4SjrSrSrSrSrSr U=r $)TiktokItemListRequesticJ>[TU]U5 X lX0lSUlg)NF)rr type_of_itemsr"exit_early_due_to_no_items)r+r2rr"ros r.rTiktokItemListRequest.__init__s$ "*.*/'r1cSU;a0URSURSS55(dSUl0$USVs0sHo"SU_M sn$s snf)Nrr"rFTr@)r]rr+rritems r.r<#TiktokItemListRequest.extract_itemssZ T !88-txx 5/IJJ26/I-1*-=>-=TT D -=>>>sAcUR(a'URRSX R5 gUR(dg[ UR 5[SUR55S- :$)Nz*%s: could not extract any %s for this userTFc38# UHoRv M g7fr)stop).0rs r. 3TiktokItemListRequest.exit_early..s$J5IVV5Isr)rrjrrr"rOr|maxrPs r.r? TiktokItemListRequest.exit_earlysc  * * MM ! !"N"%'9'9 ;##4::$JT5I5I$J!JQ!NNNr1cp0n[URR55HuupgURURR U5US-UX45(dM<SURUSSSU3nURR U5XX'Mw U$![ a USU3nN6f=f)Nrhttps://www.tiktok.com/@r7r8r)r`r|r>_matches_filtersr]r) r+rrrrrindexr@rzs r.r#TiktokItemListRequest.generate_urlss"4::??#45IE(();UQY).77 20B1*=>gbTK  r*DI6  2$ WRD1 2s#B!!B54B5cUR(a&SnURH nX';dM Sn O U(dgU(dgSU;nU(dU(dU(agU(dU(dgg)NFTr<)r") r+rrrrr range_matchr is_image_posts r.r&TiktokItemListRequest._matches_filters,s^   K-->"&K.#t+ U}]r1)rr"r) rpr1r2r3rr<r?rrr:rrs@r.rrs"0 ? O$r1rc>^\rSrSrSrU4SjrU4SjrSrSrU=r $)riCzhA less flaky version of the post/item_list endpoint that doesn't support latest/popular/oldest ordering.c(>[TU]SSU5 g)Nzcreator/item_listrYrr+r"ros r.r%TiktokCreatorItemListRequest.__init__Gs ,gGr1cn>[TU]U5 SU;deSU;deUSS:Xd USS:Xdegg)NrrHrrrr8r+rros r.r86TiktokCreatorItemListRequest.validate_query_parametersJs] )*:;++++))))  '3. V $ + ,, +/r1c[$r)rrIs r.r9(TiktokCreatorItemListRequest.cursor_typeUs%%r1r  rpr1r2r3r4rr8r9r:rrs@r.rrCs/H ,&&r1rc>^\rSrSrSrU4SjrU4SjrSrSrU=r $)riYa\Retrieves posts in latest/popular/oldest ordering. Very often, this request will just return an empty response, making it quite flaky, but the next attempt to make the request usually does return a response. For this reason creator/item_list was kept as a backup, though it doesn't seem to support ordering. It also doesn't work without cookies. c(>[TU]SSU5 g)Nzpost/item_listrYrrs r.r"TiktokPostItemListRequest.__init__ds )7ODr1c>[TU]U5 SU;deSU;deUSS;deSU;deUSS;deg)Nrr)rrrrrrrs r.r83TiktokPostItemListRequest.validate_query_parametersgsq )*:;++++,0@@@@  =>  "&6666  34 AAAr1cHUSnUS:Xa[$US:Xa[$[$)Nrrr)rrr )r+r request_types r.r9%TiktokPostItemListRequest.cursor_typeys/'(EF 3 * * S * *+ +r1r rrs@r.rrYsEB$,,r1rc>^\rSrSrSrU4SjrU4SjrSrSrU=r $)rizlRetrieves a user's liked posts. Appears to only support descending order, but it can work without cookies. c(>[TU]SSU5 g)Nzfavorite/item_listz liked postsrrs r.r&TiktokFavoriteItemListRequest.__init__s -}oNr1c>[TU]U5 SU;deSU;deUSS:XdeSU;deUSS;degNrrrrrrrs r.r87TiktokFavoriteItemListRequest.validate_query_parametersf )*:;++++,0@@@@ =>#EEE"&6666 34 AAAr1c[$rrrIs r.r9)TiktokFavoriteItemListRequest.cursor_type&&r1r rrs@r.rrs OB''r1rc>^\rSrSrSrU4SjrU4SjrSrSrU=r $)rizhRetrieves a user's reposts. Appears to only support descending order, but it can work without cookies. c(>[TU]SSU5 g)Nzrepost/item_listrWrrs r.r$TiktokRepostItemListRequest.__init__s +YHr1c>[TU]U5 SU;deSU;deUSS:XdeSU;deUSS;degrrrs r.r85TiktokRepostItemListRequest.validate_query_parametersrr1c[$r)r'rIs r.r9'TiktokRepostItemListRequest.cursor_typesr1r rrs@r.rrs IB  r1rc>^\rSrSrSrU4SjrU4SjrSrSrU=r $)rizlRetrieves a user's saved posts. Appears to only support descending order, but it can work without cookies. c(>[TU]SSU5 g)Nzuser/collect/item_listz saved postsrrs r.r'TiktokSavedPostItemListRequest.__init__s 1=( *r1c>[TU]U5 SU;deSU;deUSS:XdeSU;deUSS;degrrrs r.r88TiktokSavedPostItemListRequest.validate_query_parametersrr1c[$rrrIs r.r9*TiktokSavedPostItemListRequest.cursor_typerr1r rrs@r.rrs *B''r1rc:^\rSrSrU4SjrU4SjrSrSrU=r$)ric(>[TU]SSS5 g)Nzstory/item_listrXrrs r.r#TiktokStoryItemListRequest.__init__s *It[TU]U5 SU;deSU;deUSS;deg)Nrr)rgrrrs r.r84TiktokStoryItemListRequest.validate_query_parameterssC )*:;----!1111/3DDDDr1c[$r)rrIs r.r9&TiktokStoryItemListRequest.cursor_types$$r1r ) rpr1r2r3rr8r9r:rrs@r.rrs=E %%r1rc:^\rSrSrU4SjrSrU4SjrSrU=r$)ric(>[TU]SSS5 g)Nzstory/batch/item_listrXrrs r.r(TiktokStoryBatchItemListRequest.__init__s 0)TBr1cSU;deUSRS5S-nUS:aUS::deSU;deUSS:Xdeg)Nrrrrrr)r)r+r author_counts r.r89TiktokStoryBatchItemListRequest.validate_query_parameterssg....( 4::3?!C q \R%777#3333 01S888r1c>0n[URS55[La SUlU$USH!nUR [ TU]U55 M# U$)NbatchStoryItemListsT)rHr]rrrbrr<)r+rrr| userStoriesros r.r<-TiktokStoryBatchItemListRequest.extract_itemssY  ./ 0 <.2D +L 56K LL.{; <7 r1)r) rpr1r2r3rr8r<r:rrs@r.rrsC 9  r1rcL^\rSrSrU4SjrU4SjrSrSrSrSr Sr U=r $) ric2>[TU]S5 SUlg)Nzstory/user_listF)rrexit_early_due_to_no_cookiesrs r.r#TiktokStoryUserListRequest.__init__s *+,1)r1cJ>[TU]U5 SU;deUSS:Xdeg)Nrrrrs r.r84TiktokStoryUserListRequest.validate_query_parameterss4 )*:;#3333 01S888r1c8[R"[S5$)N storyUsers) functoolspartialr'rIs r.r9&TiktokStoryUserListRequest.cursor_types  !1<@@r1cpSU;a SUl0$USVs0sHnUSSUSS_M sn$s snf)NrTr9r@r8rrs r.r<(TiktokStoryUserListRequest.extract_itemssX t #04D -I .0.DV T"DL$<<.0 00s3crUR(aURRS5 UR$)NzFYou must provide cookies to extract the stories of your following list)rrjrnrPs r.r?%TiktokStoryUserListRequest.exit_earlys0  , , MM  !A B000r1cvURR5VVs/sH upUSU34PM snn$s snnf)Nr)r|)r+r@rvs r.r(TiktokStoryUserListRequest.generate_urlssC $ 0 0 24 2HB/v67 24 44s5r) rpr1r2r3rr8r9r<r?rr:rrs@r.rrs'29 A01 44r1r)/r4commonrrrrrrr r rr:rrrUrrCrcr r<rGrTr\r]r^r_r`rarrrrr rrrr'r0rrrrrrrrrr r1r.rs-00** 7 o- didN / 9O9* (O ".O.6L1?L1^1_1*1_1(1?1*1?1*IIXB"@-"@J(.( '/' .7,7 D3D03-3(x:x:v@3@F&,', 5',T'$9', "7 ,'%:'. %!6 %&;>4!84r1