scrapy / scrapy

Watch 1.8k
Star 36.7k
Fork 8.5k

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Pick a username

Email Address

Password

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

441 Open 1,714 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels.

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated

Most reactions

TWISTED_REACTOR setting not honored from Spider.custom_settings bug

#4485 opened Apr 12, 2020 by elacuesta

Scrapy with Puppeteer and/or Playwright?

#4484 opened Apr 11, 2020 by osmenia

Scrapy return nothing on 400 error when scraping https://www.watsons.com.sg/

#4482 opened Apr 11, 2020 by pc2000sg

Sitemap spider does not resume though JOBDIR is set

#4479 opened Apr 9, 2020 by Arregator

is_generator_with_return_value raises IndentationError with a flush left doc string bug

#4477 opened Apr 8, 2020 by mdaniel

The documentation cannot be built with Sphinx 3 bug docs upstream issue

#4475 opened Apr 6, 2020 by Gallaecio v2.1

1 3

responsetypes.py ResponseTypes.from_headers typo as 'Content-type' cleanup good first issue

#4473 opened Apr 5, 2020 by eric-et

1 2

Can not get certificate information when http body is empty. bug

#4466 opened Mar 31, 2020 by imfht

start_requests bypassing rules while working with CrawlSpider enhancement

#4463 opened Mar 30, 2020 by rhlr

FilesPipeline.file_path always getting response=None enhancement

#4457 opened Mar 27, 2020 by scratchmex

Add a CI job with PYTHONOPTIMIZE=2 CI enhancement

#4454 opened Mar 25, 2020 by Gallaecio

1 4

Make documentation about contributing beginner friendly docs enhancement

#4451 opened Mar 24, 2020 by joybhallaa

1 2

Update redirect link from Python 2 docs to Python 3 docs cleanup docs

#4444 opened Mar 19, 2020 by adityaa30

1 3

Remove defer.returnValue calls Python 3 cleanup

#4443 opened Mar 18, 2020 by wRAR

2 7

Support for Elastic APM for sending logs to elasticsearch and kibana stack enhancement

#4441 opened Mar 18, 2020 by codehia

Add a scrapy wrapper for `twisted.internet.reactor` imports enhancement

#4435 opened Mar 17, 2020 by nyov

Make scrapy interact with java script directly enhancement

#4432 opened Mar 15, 2020 by EbotFabien

Adjust throttling for 429 response codes enhancement

#4424 opened Mar 13, 2020 by ejulio

1 8

scrapy hangs requesting http://www.hpe.com/

#4423 opened Mar 13, 2020 by blushingpenguin

Implement static checks for Scrapy projects enhancement gsoc-candidate

#4421 opened Mar 12, 2020 by Gallaecio

scrapy parse emits ANSI color sequences in the Windows terminal Windows bug

#4393 opened Mar 2, 2020 by A-hoy

Deprecate environment variables being loaded as settings cleanup

#4379 opened Feb 27, 2020 by Gallaecio

1 6

Write out a SSLKEYLOGFILE if requested discuss enhancement

#4368 opened Feb 22, 2020 by nyov

Should we delete the deprecated code in Scrapy 2.0?

#4356 opened Feb 20, 2020 by noviluni

FilesDownloader with GCS downloading updtodate files again bug

#4346 opened Feb 19, 2020 by lblanche

Previous 1 2 3 4 5 … 17 18 Next

Previous Next

ProTip! Exclude everything labeled bug with -label:bug.