{"componentChunkName":"component---src-components-public-workflows-single-workflow-index-tsx","path":"/ready-made-workflow-library/scrape-articles-from-a-list-of-urls","result":{"pageContext":{"result":{"workflow":{"id":87,"name":"Scrape articles from a list of URLs","status":"completed","started_at":"1694010668127","frequency":"","created_at":"1694010738745","updated_at":"1694010738745","description":"Supercharge your research by scraping articles from a list of URLs. This captures the title and main editorial content of the article or blog post, ignoring any other navigation elements from a page.","meta_title":"Scrape Articles from a URL - Article Scraper from URL List","meta_description":"

Supercharge your research by scraping articles from a list of URLs.\nHexomatic will capture the title and main editorial content of the article or blog post, ignoring any other navigation elements from a page.\n

\n\n

This workflow is ideal for capturing content from any page, which can be used as factual data and inspiration for our ChatGPT or Gemini AI automations to write content.

","image":"https://storage.googleapis.com/hexomatic-automation-icons/public-workflows-illustrations/Scrape%20articles%20from%20a%20list%20of%20URLs.jpg","categories":[{"id":2,"name":"Marketing"}],"steps":[{"id":455,"setting":"{\"source\":{\"source_csv\":false,\"source_txt\":false},\"automation_id\":47,\"dynamic_settings\":{\"keys\":[{\"key\":null,\"settings\":{\"type\":\"Structured data\",\"columns\":[],\"storage\":null,\"jsonKeys\":[],\"inputType\":\"MANUAL_ADD_TYPE\",\"uploadedFiles\":[],\"workflowUploadId\":null,\"enableCsvCustomColumHeaders\":false,\"useCsvFirstRowsAsColumnHeaders\":true},\"inputValue\":[\"https://hexomatic.com/academy/2023/09/06/what-is-robotic-process-automation-rpa/\",\"https://hexomatic.com/academy/2023/09/04/what-is-process-mining/\"]}]},\"output_keys_data\":[\"_data_input\"],\"predefined_settings\":null,\"integration_settings\":null,\"output_keys_data_with_types\":\"{\\\"_data_input\\\":\\\"any\\\"}\"}","index":0,"created_at":"1631606440232","updated_at":null,"automation":{"id":47,"name":"Data input","url":"input","meta_title":"Data Input | Hexomatic","meta_description":"Use our data input automation as a starting point for your workflow. Provide a list of URLs or text files as input for scraping recipes or automation.","short_description":"Provide your workflow with a text or file-based input","long_description":"Provide a list of URLs, text, or TXT/CSV files inside your workflow as input for scraping recipes or automation.\n
The Data Input automation enables you to provide data as a starting point for your workflow.\n
**We currently support four types of data inputs:**\n> * File upload - Lets you upload CSV, TXT, IMAGE, PDF, AUDIO or JSON files.\n> * File URL - Lets you specify the URL of a CSV and TXT file.\n> * Manual paste - Lets you copy paste a list of URLs or keywords and iterate through each in your workflow. You can also paste blocks of text.\n
\n\n**You can then add additional automations to perform different work tasks for each URL, Keyword or data provided in the data input.**\n> * Supported image formats include: .jpeg, .png8, .png24, .png, .gif, .bmp, .webp, .raw, .ico, .jpg.\n> * Supported audio formats include: WAV, MP3, FLAC.","long_description_details":" ","has_source":null,"icon_url":"https://storage.googleapis.com/hexomatic-automation-icons/data-input.svg"}},{"id":456,"setting":"{\"source\":null,\"automation_id\":104,\"dynamic_settings\":{\"keys\":[{\"key\":\"_data_input\"}]},\"output_keys_data\":[\"_data_input\",\"_article_curator_title\",\"_article_curator_text\",\"_article_curator_top_image\",\"_article_curator_date\",\"_article_curator_author\",\"_article_curator_description\",\"_article_curator_keyword\"],\"predefined_settings\":null,\"integration_settings\":null,\"output_keys_data_with_types\":\"{\\\"_data_input\\\":\\\"any\\\",\\\"_article_curator_title\\\":\\\"text\\\",\\\"_article_curator_text\\\":\\\"text\\\",\\\"_article_curator_top_image\\\":\\\"url\\\",\\\"_article_curator_date\\\":\\\"number\\\",\\\"_article_curator_author\\\":\\\"text\\\",\\\"_article_curator_description\\\":\\\"text\\\",\\\"_article_curator_keyword\\\":\\\"text\\\"}\"}","index":1,"created_at":"1631606440232","updated_at":null,"automation":{"id":104,"name":"Article scraper","url":"article-curator","meta_title":"Article Scraper | Article Curator","meta_description":"Hexomatic's article scraper allows you to extract news article description, keywords, summary and image.","short_description":"Extract news article title, description, keywords and summary.","long_description":"Provide an article URL and extract description, keywords, text content of the page and article image.","long_description_details":"Our article scraper automation enables capturing the article text from any URL. In addition, it provides author, images and even creates a summary.\n
**Different ways to use our Article scraper automation:**\n
\n> * Via Data input automation (using the list of inputs option) to input a list of URLs.\n> * Via Data input automation (using the Upload file/ CSV file option) to scrape articles in a local CSV file.\n
\n\n**How to use our Article scraper automation via Data input:**\n
Step 1: Create a blank workflow and select Data input as the starting point.\nStep 2: Add the article scraper automation, selecting Data input as the source.\nStep 3: Click continue to run or schedule the workflow.","has_source":null,"icon_url":"https://storage.googleapis.com/hexomatic-automation-icons/article-curator.svg"}}],"tags":["Marketing"]},"prevPath":"/ready-made-workflow-library/find-all-the-urls-and-pages-from-a-website-to-csv-format","nextPath":"/ready-made-workflow-library/create-ice-breakers-for-google-search-leads"}}},"staticQueryHashes":["3915125517"]}