Twitter

Twitter Tweets API Extractor

Instant DeliveryInstant Delivery
No credit card required!

Disclaimer – Read before usage – this script utilizes Twitter's official API, hence it may come with embedded limitations. For more information please read the full description below.

1
Create a free account on Botster
2
Choose a bot and provide seed data
3
Start the bot and wait for completion
4
Download or share your results

About this bot

In short: This online tool will export tweets of a publicly open Twitter account using the official API.

Click to view an example output file.

Tweet scraping video tutorial

Watch the video demo:

Why retrieve tweets from Twitter 

Our fast and simple Twitter tweet scraper can be used for multiple business-related purposes, such as:

  • Improving your social media strategy
  • Analyzing your competition’s social media
  • Analyzing the interests of your target audience
  • Monitoring current trends
  • And many more!

The tweet extractor can easily grab the following details:

  • Username (e.g. Elon Musk)
  • User handle (e.g. @elonmusk)
  • Posting date
  • Text
  • Retweet count
  • Like count

How to scrape tweets from Twitter

  • Sign up on Botster
  • Go to the bot's start page
  • Select the number of tweets to scrape (10 to 1000)
  • Choose whether you would like to skip retweets and/or replies
  • Tune the filters: select the acceptable range of likes and retweets
  • Paste a Twitter profile link (e.g.: https://twitter.com/elonmusk)
  • Click the “Start this bot” button

That's it – the bot has started web scraping tweets from Twitter!

Known limitations

The current maximum number of tweets that we can export is limited to 1000.

If you need to export all tweets from a user that has over 1000 tweets, the bot will retrieve the most recent records.

Software walkthrough

1. Open the Launch bot form.

Click on the "Start bot" button on the right-hand side of this page to open the spider's form:

2. Enter the details.

Give your "Job" a meaningful title, and optionally specify (or create) a project folder:

3. Set the limit.

Specify how many tweets you would like the tweet scraper to retrieve:

4. Tune in the skipping filters.

Tick these checkboxes if you would like to skip retweets and/or replies:

5. Tune in tweet settings.

You can set the bot to:

  • Extract all tweets from a user
  • Extract the tweets that have a certain number of likes
  • Extract the tweets that have a certain number of retweets

6. Copy the Twitter account URL.

Open the Twitter account that you would like to scrape Twitter tweets from and copy its URL:

7. Paste the Twitter account URL.

Go back to the bot’s start page and enter the Twitter profile URL into a special field:

8. Set up notifications.

Specify if you would like to receive a notification when the tweet extractor completes the crawl:

9. Start the bot!

Click the "Start this bot" button on the right-hand side:

That's it! You will be taken to your "Jobs" section. The tweet scraping software is now working and will notify you once it's done.

Data output

Once the tweet extractor completes the job, you can view your data online or export and download it as an Excel, CSV or JSON file

To use this bot you need to register or log in first.

Frequently asked questions

In most cases, that’s because your settings are too strict. For example, consider ticking ‘Extract all tweets’ instead of ticking ‘Tweets with more than XXX likes/retweets’. Another reason may be that you’ve inserted a wrong Twitter account URL or an URL that doesn’t exist.

Once the bot is done scraping, open your job, click on the menu in the top right corner, and select the Excel or the CSV logo. This simple action will allow you to download tweets to Excel or CSV respectively and to save them to your computer. Other formats available for download include JSON and Google Sheets.
You can’t export tweets to PDF directly but you can do the following: download your data as an Excel file, open this file, go to the top menu, click on ‘File’, and select ‘Export as PDF’. Your tweets wil be saved to your computer in the PDF format.

Our tweet extractor was created using Python, yet you need no coding knowledge to use it.

Select the number of tweets to scrape, tune the filters, paste the link to your Twitter profile (e.g.: https://twitter.com/yourprofile), and launch the bot. All your tweets will be exported into a spreadsheet.

This bot retrieves tweets using the official API.


Endpoint: POST https://botster.io/api/v2/bots/twitter-tweets-scraper

Request body:

input string or array of strings (required)
User page

twitter_scraper_filter (required)
Filter

limit string (required)
Limit
Possible values:

10Up to 10 tweets
100Up to 100 tweets
1000Up to 1000 tweets

cron string (optional)
Set periodicity with which the process should execute. Use cron format.
Example: 0 8 * * * - run every day at 8AM

new_items_only boolean (optional)
The file will contain only the new items that appeared since the latest data crawl.

Thumb person  34

This tool helped me a ton with my research on social media. THANK YOU!

1/3
Thumb w

Good to have all tweets of a user at hand in order to monitor Twitter trends!

2/3
Thumb m

I use this bot to analyze which tweets receive more likes and retweets. And to improve my SMM strategy!

3/3


Your file is being prepared...