FreeAI::ChatGPT - Scraper for the ChatGPT AI Service
Scraper Overview
The ChatGPT - Scraper is a modern tool for collecting information from the most popular AI service. Thanks to integration with ChatGPT, you receive not just text and link lists, but actual, compressed, and relevant answers based on a large number of sources, including scientific articles, blogs, forums, and news portals.
The ChatGPT Scraper supports natural language queries, , including clarifications, contextual questions, and nested structures.
The processing speed reaches 100–200 queries per minute due to multithreaded operation. Depending on the configuration and presets used, you can receive hundreds of unique text fragments and links within minutes.
Output results can be saved in any desired format thanks to the powerful Template Toolkit, templating engine, which allows structuring data into JSON, CSV, SQL and other formats, as well as applying filtering, sorting, and data aggregation on the fly.
The ChatGPT Scraper is ideal for competitive intelligence, fact and quote collection, knowledge base creation, news monitoring, and topic analysis, thanks to the high quality and contextuality of the results provided. It can also be used to search for thematic images.
Collected Data
- Response text (in Markdown formatting)
- Links, anchors, data source snippets, as well as their icons and usage type in the response
- Images (if present in the response): links to the image, preview, page, and title
- Name of the model used
Capabilities
- Enabling internet search
- Bypassing protections and supporting sessions for more stable and faster operation
Use Cases
- Collecting structured answers and images for thematic queries to create knowledge bases, content plans, reference systems, and FAQ generation
- Extracting source links with anchors and snippets — ideal for building lists of authoritative resources, citing, and collecting backlinks
- Monitoring mentions of brands, products, or persons — linked to context and sources
- Searching and analyzing expert opinions, trends, and insights from authoritative sources
- Quick check of information relevance and completeness on key topics
- Automating competitor analysis: which resources are cited, what topics are covered, and how often
- Supporting research and analytical projects that require aggregating accurate information from various sources
- Any other tasks requiring fast, concise, accurate answers with confirmation from real sources and logical context
Queries
The queries should be search queries, exactly as if they were entered directly into the ChatGPT question field, for example:
What is A-Parser?
How to learn fast?
How to improve memory and concentration?
Results
info
The result examples below are shortened for better clarity.
By default, the query and its response are output, for example:
What is A-Parser?
**A-Parser** — is a powerful tool for automated data collection (scraping) from various internet sources. It is most often used for SEO tasks, search results analysis, collecting information from websites, monitoring competitors, and other tasks related to extracting data from web pages.
### Key features of A-Parser:
1. **Multithreading**
Supports operation with a large number of threads, allowing large volumes of data to be collected quickly.
...
How to improve memory and concentration?
Improving memory and concentration — is a process that requires regular practice and a healthy lifestyle. Here are proven ways that actually work:
---
## 🧠 1. Healthy lifestyle
**Sleep:**
- Sleep 7–9 hours every night.
- Lack of sleep reduces attention, concentration, and long-term memory.
**Nutrition:**
- Eat more foods rich in omega-3 (fish, walnuts).
...
How to learn fast?
Learning to learn fast — is a skill that can be developed. Here is a systematic approach to becoming more effective in learning:
---
### 📌 **1. Understanding Learning Principles**
- **Active learning** — instead of passive reading/watching, use:
- retelling in your own words;
- explaining the material to an 'imaginary student' (Feynman technique);
- problem-solving or case studies;
- **Spaced repetition** (spaced repetition) — it is better to repeat the material at increasing intervals than to cram.
...
Output Result Examples
A-Parser supports flexible result formatting thanks to the built-in Template Toolkit, templating engine, which allows it to output results in arbitrary forms, as well as structured ones, such as CSV or JSON.
Exporting a list of links and their types
Result format:
$sources.format('$type - $link\n')
Example result:
...
citation - https://en.a-parser.com/?utm_source=chatgpt.com
citation - https://capmonster.cloud/ru/blog/scraping/a-parser-x-capmonster-cloud-parsing?utm_source=chatgpt.com
citation - https://ru.news.proxy.market/nastroyka-proksi-servera-a-parser?utm_source=chatgpt.com
other - https://en.a-parser.com/
other - https://a-parser.com/
other - https://crozdesk.com/software/a-parser
...
Outputting image links, their previews, and titles to CSV
Result format:
[% FOREACH item IN sources;
tools.CSVline(loop.count, item.link, item.anchor, item.snippet);
END %]
Example result:
https://www.hawkmountain.org/data/uploads/media/image/barn-owl-by-Traci-Sepkovic.jpg?w=1024,https://images.openai.com/thumbnails/url/VgTsVnicu1mSUVJSUGylr5-al1xUWVCSmqJbkpRnoJdeXJJYkpmsl5yfq5-Zm5ieWmxfaAuUsXL0S7F0Tw4MLc1yCsx3zM0tMPdKqfIO13UpLsrySgpPNyvJLzQy9jbNd0pNDQ22KEj1Cs80DzUKtLQo8MqPyvQvc1QrBgAn1inp,hawkmountain.org/raptors...
https://cdn.download.ams.birds.cornell.edu/api/v1/asset/297388681/1200,https://images.openai.com/thumbnails/url/hrzNoXicu1mUUVJSUGylr5-al1xUWVCSmqJbkpRnoJdeXJJYkpmsl5yfq5-Zm5ieWmxfaAuUsXL0S7F0Tw6uSC008PEyLiw1j_QxMKw0Cwmv8Io3yDQJLCkpMTQOKktOjCpNKSorjKgyNgy3cMzPjvAz8c8INAhUKwYAwr0pAA,birdsoftheworld.org/bow/...
https://gpnc.org/wp-content/uploads/2017/12/Great_Horned_Owl_Bob_Gress_120116_0784_KS.jpg,https://images.openai.com/thumbnails/url/E489Q3icu1mUUVJSUGylr5-al1xUWVCSmqJbkpRnoJdeXJJYkpmsl5yfq5-Zm5ieWmxfaAuUsXL0S7F0Tw72KjSOj0jJrcwwKnOO94goTS7I1XVMS_Rxd3f3N842CrEILDevSq7w8jXIK_A2MnVyS6rK0c32MLBUKwYAxlQonQ,gpnc.org/fauna/birds/gre...
https://upload.wikimedia.org/wikipedia/commons/thumb/5/56/Bubo_bubo_sibiricus_-_01.JPG/960px-Bubo_bubo_sibiricus_-_01.JPG,https://images.openai.com/thumbnails/url/r9I8Dnicu1mUUVJSUGylr5-al1xUWVCSmqJbkpRnoJdeXJJYkpmsl5yfq5-Zm5ieWmxfaAuUsXL0S7F0Tw6Jr8ovi_DKM0vOzTQwSAmPNAswTsz1yyqpKjU3ysrKCXJ2MQ71CrYwyA4vCPZ2LSrI83P2LU10KTJWKwYA0n8pRw,en.wikipedia.org/wiki/ow...
tip
The General Result Format uses the Template Toolkit templating engine to output the $sources array in a FOREACH loop.
In the result file name, you simply need to change the file extension to csv.
Outputting the question, answer, and the name of the model used to JSON
Общий формат результата:
[% IF notFirst;
",\n";
ELSE;
notFirst = 1;
END;
obj = {};
obj.query = query;
obj.answer = p1.answer;
obj.model = p1.model;
obj.json %]
Начальный текст:
[
Конечный текст:
]
Example result:
[{"answer":"To learn quickly, you need to develop several important skills and habits. Here are several approaches that can help:\\n\\n### 1. **Active Learning Method**\n Instead of passive reading or listening, actively engage with the material:\\n - Put information into practice.\\n - Explain what you are learning to others (or even yourself out loud).\\n - Create mind maps, diagrams, or notes to better organize information.\\n\\n### 2. **Chunking Information**\n Divide complex information into smaller, manageable chunks. For example, if you are learning a language, memorize basic words first, then phrases, rather than trying to learn everything at once.\\n\\n### 3. **Spaced Repetition Method**\n Break down studying into intervals: return to the material after some time (after 1, 2, 3 days, etc.). This helps reinforce memory.\\n\\n### 4. **Mind Maps and Visualization**\n Using diagrams, mind maps, and other visual tools helps speed up the perception and memorization of information. This also helps organize thoughts more clearly.\\n\\n### 5. **Focus on Deep Understanding**\n Do not strive for rote memorization. Better understand how the topic you are studying works, what and why things happen. When you understand the logic, memorizing becomes much easier.\\n\\n### 6. **Practice and Repetition**\n Do not be afraid to make mistakes and repeat the material several times. The more you interact with the information, the faster you will master it.\\n\\n### 7. **Rest and Sleep Intervals**\n Breaks and adequate sleep are critically important for information to be absorbed into long-term memory. The right balance between work and rest is — a key point in fast learning.\\n\\n### 8. **Motivation and Goals**\n Define clear goals and find the motivation that will support you. Structured learning is always more effective if there is a clear understanding of why it is needed.\\n\\n### 9. **Diversity of Information Sources**\n Use different formats: books, videos, online courses, audio, etc. This helps absorb information better, as different perception channels activate different parts of the brain.\\n\\n### 10. **Using Technology**\n Take advantage of educational apps and platforms that use algorithms to select material based on your knowledge level (e.g., Anki for spaced repetition).\\n\\nDo you already have experience with any learning methods that you would like to improve or add?","query":"How to learn fast?","model":"i-mini"},
{"answer":"**A-Parser** — is a powerful tool for scraping (collecting) data from various sources, such as search engines, websites, APIs, and other online resources. It is especially popular among SEO specialists, marketers, affiliates, and developers who need to automate the collection of large volumes of information.\\n\\n### Key features of A-Parser:\\n\\n1. **Source Flexibility**: \n Supports many scrapers out of the box — Google, Bing, Yandex, Amazon, YouTube and others. You can also create your own scrapers using templates in the A-Script language.\\n\\n2. **Multithreading**:\n Allows running hundreds or even thousands of threads, making data collection fast and scalable.\\n\\n3. **Proxy Support**:\n Supports working with proxy servers (HTTP, HTTPS, SOCKS), allowing you to bypass blocks and bot protection.\\n\\n4. **User-Agent and Proxy Rotation**:\n Allows simulating the behavior of different users and avoiding bans from sources.\\n\\n5. **Customizable Output**:\n Results can be saved in various formats (CSV, TXT, JSON, etc.) with the desired structure.\\n\\n6. **API and Automation**:\n It has a convenient API, the ability to run via the command line, and integrations with other scripts and systems.\\n\\n7. **Web Interface**:\n It has both a web interface and a console version. Settings can be complex for beginners but flexible for experienced users.\\n\\n---\\n\\n### Application Examples:\\n\\n- Collecting search engine results (SERP)\\n- Collecting information about products (prices, availability, descriptions)\\n- Scraping email addresses or phone numbers\\n- Monitoring competitors\\n- Generating a keyword database\\n\\n---\\n\\nIf you like, I can show an example of setting up a simple scrape or explain how to create an A-Script template.","query":"What is A-Parser?","model":"gpt-4o"},
{"answer":"To improve memory and concentration, there are several proven methods. Here are some tips:\\n\\n### 1. **Physical Activity**\nRegular exercises such as running, swimming, or yoga stimulate blood circulation and activate brain function. This helps improve cognitive functions, including memory and concentration.\\n\\n### 2. **Proper Nutrition**\nNutrition plays a huge role in brain function. To improve memory and concentration, it is important to eat:\\n- **Omega-3 Fatty Acids** ((in fish, flaxseed oil, nuts).\\n- **Antioxidants** ((berries, green tea, dark chocolate).\\n- **B Vitamins** ((eggs, whole grains, greens).\\n- **Magnesium and Potassium** ((bananas, nuts, seeds).\\n\\n### 3. **Learning New Things**\nMastering new skills or learning new material is — an excellent way to train memory. This not only helps maintain brain activity but also increases the ability to concentrate.\\n\\n### 4. **Meditation and Mindfulness**\nMeditation helps develop concentration and attention. Mindfulness practices teach you to be 'here and now,' which improves the ability to focus on tasks.\\n\\n### 5. **Good Sleep**\nRestless sleep or lack thereof affects memory and attention. Try to sleep 7-9 hours every night. Good sleep promotes memory consolidation and nervous system restoration.\\n\\n### 6. **Mnemonic Techniques**\nUse memorization techniques such as:\\n- **Associations**: (link new information with already known facts).\\n- **Mnemonic Phrases**: (create phrases that help remember complex data).\\n- **Method of Loci**: (imagine a familiar place and associate information with specific objects in that place).\\n\\n### 7. **Stress Management**\nHigh levels of stress disrupt brain function, which affects memory and concentration. Regular relaxation techniques, breathing exercises, and rest will help reduce stress levels.\\n\\n### 8. **Organizing Your Workspace**\nCleanliness and order in your workspace contribute to improved concentration. Constant clutter can be distracting.\\n\\n### 9. **Planning and Delegation**\nOften, concentration problems arise when too many tasks overlap. Break tasks down into small steps, use planners and apps for time organization.\\n\\nHow do these tips sound? Is there anything you would like to try first?","query":"How to improve memory and concentration?","model":"i-mini"}]
Possible Settings
| Parameter Name | Default Value | Description |
|---|---|---|
| Search the web | ☐ | Internet search |
| Browser headless | ☑ | If this option is enabled, the browser will not be displayed |
| Use sessions | ☑ | Saves good sessions, allowing for even faster scraping with fewer errors |
| Log page screenshot (debug) | ☐ | Takes a screenshot of the response page and outputs it to the task log |