Download and rewrite article content from a list of URLs

Are you looking to do the following?

You have a CSV file of urls as a content source. Use that CSV with links and rewrite the content from those urls.

The quickest way to convert a list of URL links to re-written content is to use the static page scraper.

  1. You need a list of URLs (just urls one per line, so no CSV file)
  2. Some knowledge of CSS so you can pick what content to re-write

Create page scraper task using static scraper

Create new static scraper task.

Paste your list of urls.

Or you can load a file.

Just make sure you provide a list of urls, (so process your csv files first).

Choose content to re-write

By default, SCM will download all the h1-h2-p content on a page it can find.

You have many options to remove and manipulate the content being scraped or processed using REGEX.

How to re-write content from URLs

Choose the type of re-writer to use.

SCM supports both normal spinners and AI models to do re-writing.

For AI, choose AI Rewriter.

To change the default AI model, go to API logins.

Click ‘default AI model’ dropdown.

To start the task, click RUN.

Check the output of the task

When the task is running, status is printed to the task log.

Content is read from your URL and each line is sent to the AI model to get rewritten.

1 Like