What is Parse.ly?

Direct Answer

Parse.ly is a content analytics tool operated by Parse.ly, used for monitoring content performance.

User-Agent
Mozilla/5.0 (compatible; parse.ly scraper/0.16; +http://parsely.com)

Parse.ly is a content analytics platform that provides insights into content performance. It offers an intuitive dashboard for real-time data, conversions, and reporting. The platform is used by many major media and content teams.

User-Agent Identification

The following user-agent strings identify Parse.ly in your live traffic data:

  • Mozilla/5.0 (compatible; parse.ly scraper/0.16; +http://parsely.com)

robots.txt Rules for Parse.ly

Respects robots.txt: Yes

Use the following robots.txt rules to control Parse.ly access:

robots.txt
# Block Parse.ly
User-agent: parse.ly scraper
Disallow: /

# Allow Parse.ly
User-agent: parse.ly scraper
Allow: /

Robots.txt is a directive, not a barrier

Parse.ly states that Parse.ly respects robots.txt. However, configuration mistakes, caching delays, and edge cases mean your directives may not always be followed as expected. Live traffic verification confirms whether Parse.ly actually obeys your rules in practice.

Need continuous verification across 487 bots? Can AI See It automates this.

Crawl Behavior

Frequency: Not Documented

Request Pattern: Not Documented

Official Documentation Quotes

If you have an editorial team creating content daily that needs feedback on the performance of that content, then Parse.ly is the number one tool for the job.

Source:Official Documentation

Parse.ly is the tool that makes it fun, simple, easy, and not scary to get data—you want to start using it on a daily basis.

Source:Official Documentation

Why track Parse.ly traffic?

Distinguish monitoring traffic from real crawler activity. Parse.ly checks your site availability at regular intervals. Without proper identification, these requests can inflate your bot traffic metrics and distort crawl analysis.

Validate monitoring coverage. Track which pages Parse.ly checks and how frequently, so your monitoring setup matches your infrastructure requirements.

Log Verification

To verify Parse.ly traffic in your live traffic data:

  1. Search access logs for the user-agent strings listed above
  2. Check if the IP addresses match documented ranges (if provided by Parse.ly)
  3. Verify the crawl pattern matches documented behavior
  4. Use reverse DNS lookup for additional verification if available

Note: Observed behavior in production environments may differ from official documentation. Live traffic monitoring provides the only reliable verification of actual bot behavior.

Undocumented Information

The following information is not officially documented for Parse.ly:

  • crawl frequency
  • request pattern
  • IP verification method
  • JavaScript rendering

Official Documentation

View Official Parse.ly Documentation parse.ly

Information sourced from official documentation. Content generated with AI assistance.

Waitlist open

See Parse.ly in your own traffic

Can AI See It shows when Parse.ly visits, whether the requests are genuine and what Parse.ly sends back.

No spam. Launch updates only.