i% ( S r SSKJrJr SSKJrJr " S S\5 r " S S\5 r\R S S
S S .05 r
S
r S\ - r " S S\5 r
" S S\5 r " S S\5 r " S S\5 r " S S\5 r " S S\5 r " S S \5 rg
) z!Extractors for Postmill instances )
BaseExtractorMessage )text exceptionc 4 \ rS rSrSrSrSrSrSrS r S r
S r g
) PostmillExtractor
z"Base class for Postmill extractorspostmill)z
{category}z
{instance}z{forum}z {id}_{title[:220]}.{extension}z
{filename}c U R R S5 S U l U R SS5 U l [
R " S5 R U l [
R " S5 R U l g )Nz://r zsave-link-post-bodyFz/f/([\w\d_]+)/(\d+)/z1z4zr r /zz)titledateusernameforumidflairr ztext:count num)r( htmfilename extension) post_urlsrequestr extract_fromunescapeparse_datetime_isor intr extract_iterr r appendr UrlQueuelen Directory enumerate
startswithnameext_from_url)r post_urlpageextrr! r" r# post_canonical_urlurlbodymatchr$ r% is_text_post
is_image_postidataurlsmsgs r itemsPostmillExtractor.items sS (H<<)..D$$T*DMM$5t#= >E**4F,N OD>FH!% t.06 "7 --L! C ED ../ABE!HEU1X B FcML 2 24 8 DM $ 484E4E75D E 5Dq$--* 5D E MM D Dt 7 7 W[['D. 9: W[[# ./! W]]C 01 IDM##R- -+4T1+='U Zc3>>'**:C7D$d;&7 00d;D3n$
,>a )@Es D%I0' I+D)I0)r r r r N) __name__
__module__ __qualname____firstlineno____doc__ basecategory
directory_fmt filename_fmt archive_fmtr rI __static_attributes__ r r r r
s$ , L;M3L KI7%r r c . \ rS rSrSrSrS rS rS rSr g) PostmillSubmissionsExtractorU z.Base class for Postmill submissions extractorsrU c F [ R X5 UR 5 nUS U l US =( d SU l [
R " US 5 R 5 VVs0 s H u p4U R U5 ( d M X4_M! snnU l g s snnf )Nr( )
r __init__groupsbase sorting_pathr parse_queryrI acceptable_queryquery)r rB r^ keyvalues r r] %PostmillSubmissionsExtractor.__init__Y s ""4/ 2J "2J ,"373C3C 2J4 4 ? 4 ZS#'#8#8#= !cj 4 ?
?s - B
B c # # U R U R U R 3nU( Ga U R XR S9nUR
( a8 UR nX0R S- :X a [ R " SU S35 eUR n[ R " USS5 H^ n[ R " [ R " USS5 5 n[ R [ R " X5 S [ 04v M` [ R " [ R " US
S 5 5 nU( a GM g g 7f) N)paramsz/loginz HTTP redirect to login page ()z z >r )r$ r N) rK rL rM rN rO subcategory BASE_PATTERNrz exampler] r- rT rU r r rn rn s$ /K ..G3G
?r rn c 0 \ rS rSrSrSr\S- rSrS r Sr
g) PostmillShortURLExtractor z#Extractor for short submission URLsshorturlz(/\d+)$zhttps://raddle.me/123c # # U R U R S - nU R U5 n[ R " X5 n[
R US[ 04v g 7f)Nr rj )r
r^ request_locationr rm r r6 rn )r r@ locationfull_urls r rI PostmillShortURLExtractor.items sP ii$++a.(((-<<.mmX 6K'LLLs A A"rU N) rK rL rM rN rO r r rz r rI rT rU r r r r s - KZ'G%GMr r c . \ rS rSrSrSr\ S\ 3rSr Sr
g)PostmillHomeExtractor zExtractor for the home pagehomez (/(?:featured|subscribed|all)?)zhttps://raddle.me/rU N rK rL rM rN rO r r
SORTING_RErz r rT rU r r r r s %K >zlKG"Gr r c . \ rS rSrSrSr\ S\ 3rSr Sr
g)PostmillForumExtractor z$Extractor for submissions on a forumr$ z(/f/\w+)zhttps://raddle.me/f/FORUMrU Nr rU r r r r s .K x
|4G)Gr r c . \ rS rSrSrSr\ S\ 3rSr Sr
g) PostmillUserSubmissionsExtractor z(Extractor for submissions made by a userusersubmissionsz(/user/\w+/submissions)()z'https://raddle.me/user/USER/submissionsrU N) rK rL rM rN rO r r QUERY_RErz r rT rU r r r r s 2#K 8
CG7Gr r c . \ rS rSrSrSr\ S\ 3rSr Sr
g)PostmillTagExtractor z8Extractor for submissions on a forum with a specific tagtagz
(/tag/\w+)zhttps://raddle.me/tag/TAGrU Nr rU r r r r s BK z* 6G)Gr r c . \ rS rSrSrSr\S- rSrSr Sr
g) PostmillSearchExtractor z Extractor for search resultsr z(/search)()\?(q=[^#]+)$z https://raddle.me/search?q=QUERY)qrU N) rK rL rM rN rO r r rz r rv rT rU r r r r s &K 77G0G #r r )rO commonr r r( r r r rW updater r r rn r r r r r r rU r r r s ( * E%
E%P$<#4 $