Symfony Web Scraper



Maintainers
Details
  1. Symfony Web Scraper Software
  2. Symfony Web Scraper
  3. Symfony Web Scraper Download
  4. Symfony Web Scraping

Today, an introduction blog post to Panther was published on the Symfony blog! Panther is a new browser testing and web scraping library I contributed to the Symfony project, In the blog post, I showcase how to use Symfony, API Platform and VueJS together to create a small but modern app, and how to test. If you use Symfony 4/5, there is a great Symfony bundle for Prometheus. Metrics are stored either in apcu or in Redis. The README has everything you need to set it up, I’ll just provide a simple example. After enabling the bundle via flex or using README, add collector registry as a dependency.

Installs: 28 909 271

Dependents: 385

Suggesters: 3

Security: 0

Stars: 8 368

Watchers: 357

Forks: 968

Open Issues: 129

Type:application

Requires

  • php: >=7.1.3
  • symfony/browser-kit: ^4.4|^5.0
  • symfony/css-selector: ^4.4|^5.0
  • symfony/dom-crawler: ^4.4|^5.0
  • symfony/http-client: ^4.4|^5.0
  • symfony/mime: ^4.4|^5.0

Replaces

None

This package is auto-updated.

Last update: 2021-03-29 00:15:36 UTC

Goutte is a screen scraping and web crawling library for PHP.

Goutte provides a nice API to crawl websites and extract data from the HTML/XMLresponses.

Requirements

Symfony Web Scraper Software

Goutte depends on PHP 7.1+.

Installation

Add fabpot/goutte as a require dependency in your composer.json file:

Usage

Create a Goutte Client instance (which extendsSymfonyComponentBrowserKitHttpBrowser):

Make requests with the request() method:

The method returns a Crawler object(SymfonyComponentDomCrawlerCrawler).

To use your own HTTP settings, you may create and pass an HttpClientinstance to Goutte. For example, to add a 60 second request timeout:

Click on links:

Extract data:

Submit forms:

More Information

Web

Read the documentation of the BrowserKit, DomCrawler, and HttpClientSymfony Components for more information about what you can do with Goutte.

Symfony

Pronunciation

Web

Symfony Web Scraper

Goutte is pronounced goot i.e. it rhymes with boot and not out.

Symfony Web Scraper Download

Technical Information

Goutte is a thin wrapper around the following Symfony Components:BrowserKit, CssSelector, DomCrawler, and HttpClient.

License

Symfony Web Scraping

Goutte is licensed under the MIT license.