Horseman v0.3.2 out now, with GPT integration and much more.

Crawl the web the way you want.

Join the frontend developers, performance analysts, digital agencies, accessibility experts, seo specialists, javascript engineers using Horseman and supercharge your snippets for expert insights across your whole site.

Horseman

Horseman is your endlessly configurable crawling companion.

v0.3 available for Windows, Mac OS (Intel and M1/M2), and Linux

New with Horseman v0.3

🕷️ Crawl the web with GPT3.5 and use page content with prompts; combine any piece of page data, or send the entire page to GPT for analysis.
🤖 Don't know JS? Create snippets with an AI helper instead.
🌌 Deeper exploration with new the Insights feature.
🤯 Huge number of new snippets and much more.

Detailed Update Notes v0.3

Get Instant Access Now

The Horseman snippet library showcasing a small number of performance snippets.

The Horseman snippet editor; using GPT to create poems from meta descriptions.

The AI created poems returned into straight into the Horseman results table.

The Horseman results table showing an example output of a variety of snippet types.

Exploring the insights generated from a crawl.

Deeper exploration of insights, drilling down into the pages with issues.

Snippet Powered

Snipwhats?

Snippets are tiny pieces of JavaScript code that allow you to interact with a website to manipulate it and return information. Anything you can use with Chrome's DevTools console you can utilise and automate with Horseman across an entire site.

That sounds amazing, but I don't know JavaScript.

Don't worry! There are over 120 built in snippets; and now with Horseman v0.3 you can even describe the information you want to extract and let AI write the snippet for you!

120+ Snippets

Just some of the 120+ essential snippets for developers, tinkerers, content creators, technical SEOs, and more.

Largest Contentful Image Priority

Detect when the Largest Contentful Paint has been mistakenly loaded with a lower priority.

H1 Sentiment

Analyse the sentiment of your H1 headings and make them the best they can be.

Overflowing Elements

Detect and diagnose elements that overflow the page and cause unwanted scrolling.

Intelligent Content Extraction

Intelligently extract content with Mozilla's readability.js.

Summarize Content

Summarize page content with GPT and use it to write new relevant meta descriptions.

Early Bird Pricing

Get instant access with Early Bird prices via GitHub Sponsors.

GitHub Sponsors?

I'm utilising GitHub Sponsors as a payment gateway and as a way for people to support this and my other projects; allowing me to focus my development time on Horseman first and add additional payment gateways later.