NET::HTTP - Save page and parse at same time?

Discussion in 'A-Parser Support Forum' started by scrapefun, Sep 2, 2021.

  1. scrapefun

    scrapefun A-Parser Enterprise License
    A-Parser Enterprise

    Joined:
    Feb 24, 2015
    Messages:
    184
    Likes Received:
    34
    I have a NET:HTTP preset that queries Google and downloads the raw html.

    Is it possible to save the whole page and at the same time also parse the $link and $anchor data and save to a txt file like with the Google Parser?

    I assume it would require some regex to get the $anchor and $link data but I also don't know how to format the results to both download the data and parse it at the same time.

    I would just use the Google Parser but for whatever reason I get much better performance using Net:HTTP with the one group of proxies I am using.

    Here is my current preset:
    eJyNVm1vGjkQ/iuW1YbkRHeXJuFyIHRKuaZvCeQCUT8EhNzdYfHhtTe2NyRH+e8d
    m82yqa7JoSjC43lmnnk1a2qZWZpLDQasoZ2bNc39d9qhA7Cdzsfx+JJ8UCoVQJs0
    Z9qAdno3u2uUJzBnhbC0uab2IQcEqzvQmicOxBM8p0olfeXPd0wUqHLzNoqmm18j
    CvT0hqUg7Q5DL9S/XAgWHgcR2f/KZaJWhgzGpBUFUZegoH3UJfftowNymucCvsK3
    L9yGx4e/B4dtsv/l4/jivEkEXwL5APFSHZD+QqsMwpOTIAqODt8eBa2TNhmxOdO8
    hNFnOOZa3T9osJqDqbFsRVH0IuwbkxKSWACTRV4DP4u0PANV1DPSflYfk+id7QBW
    F/AMQMNtAcYmINjD/yXlPfQXmFDQNcxvTzC55UqaR0jstPtK2qflXdhMEG4hM7HK
    oTehE+qPzgieFtbmnTA0iM5YoHQajoDpeHEFBrvPXGK3IEAwmaIyyAlF0yxJuHPN
    BO2sn/i9YDZejD291mYznTYxeG/nTOmMuQm4eU0+nZG8FXA5V4Ep4hiMIb0eaXUn
    cmLxImGWkRlBoiigKH0/+Av/X4/eEzS/wK8J16TnD2jF7mN29UMgi4yE5I8oOiCv
    p7RyPGJ3MFboeM79uD3ywdOAZfAyI7zbOhB3wkkjlBL8TGyNESk/LzArNbcBTWwD
    xzGfabYKC/OmgTE7+Iw0Qvd9i12unCBwRWx0EbeNbVeAbV6328Nik83mjIvwejR7
    hWkEF3Mw9yr7B4G9d33xy3Ajz2lCXz16ruV/69b91Wp6LfmtbzGp8MahcGTPcPbd
    UIF35k091v7G+b7F/FShfSeF5ujhv3LccJ1psDVXq1WQ+m0ZxCoolqHxDfrnbc+n
    yeVnL1+ZXrSXil5h9jDdveOosSOOjAtP9e8txe3ANqnB1jjDdEFSXcyZMHiD86GZ
    VXpYThh2uZKnQpzDHYgK7ym/K7hIcH+fzhHzqcRVhp6oDH82salSWXeEm2ClkUFl
    xJ/eDS9KAaISda7Sx8QLnnGLZ9NXhbR+sTTpEiCv6jNwapnSULkpLZfe8anKQbod
    shsQ3PWV6EkU/kEzqtCxM+2vUKVcSQbXtkxHueCu+rgoWZkP2nVKyjXBcuVeN67p
    dLPrpZp1FMZKznk6LHdiKdSFHOPDOpR9leE75BIkCyGabiFf7ab61JTVdIddpD+D
    +94FEqveWaSnhPk82saca45sjx3BDEtS91qajJkQ11fn9Ru6mwM/A8aZjXEQU4VZ
    wihcxOWDX/0+WNee/c56g+X9B9eu13EhOA2UYS4M1s7t1R/kVcmc

    Let me know if I should submit this as a paid task.

    Thanks.
     
  2. Support

    Support Administrator
    Staff Member A-Parser Enterprise

    Joined:
    Mar 16, 2012
    Messages:
    4,557
    Likes Received:
    2,167
    Just add the output to another result file and save the data you want to it.
    [​IMG]
     

Share This Page