scrapy / scrapy

Watch 1.8k
Star 36.2k
Fork 8.4k

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Pick a username

Email Address

Password

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

426 Open 1,693 Closed

Author

Filter by author

Label

Filter by label

Use alt + click/return to exclude labels.

Projects

Filter by project

Milestones

Filter by milestone

Assignee

Filter by who’s assigned

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated

Most reactions

"Empty separator" error while pasting .split("some-non-ascii-character") into scrapy shell.

#4397 opened Mar 2, 2020 by somestupidpersonLA

scrapy parse emits ANSI color sequences in the Windows terminal Windows bug

#4393 opened Mar 2, 2020 by A-hoy

Deprecate environment variables being loaded as settings cleanup

#4379 opened Feb 27, 2020 by Gallaecio

Write out a SSLKEYLOGFILE if requested discuss enhancement

#4368 opened Feb 22, 2020 by nyov

Should we delete the deprecated code in Scrapy 2.0?

#4356 opened Feb 20, 2020 by noviluni

FilesDownloader with GCS downloading updtodate files again bug

#4346 opened Feb 19, 2020 by lblanche

Ability to Update Previously-Crawled Data discuss enhancement

#4341 opened Feb 18, 2020 by atlowell-smpl

Needs change on "Example of shell session" in Scrapy 1.8.0 docs docs enhancement

#4336 opened Feb 17, 2020 by dedenhabibi

Scrapy fails to crawl emoji domains, raises idna.core.InvalidCodepoint bug upstream issue

#4330 opened Feb 13, 2020 by john-parton

General Message Queues as Storage for Requests enhancement gsoc-candidate

#4326 opened Feb 10, 2020 by whalebot-helmsman

Having an option to define an Items output file in the `scrapy parse` commnad line enhancement

#4317 opened Feb 7, 2020 by raphapassini

1 10

Use f-strings cleanup good first issue

#4307 opened Feb 6, 2020 by Gallaecio Python 3.6+

Add a setting to choose a custom AsyncIO loop enhancement

#4306 opened Feb 6, 2020 by Gallaecio

Allow checking that settings are named correctly discuss enhancement gsoc-candidate

#4302 opened Feb 5, 2020 by Gallaecio

Make it easier to use Scrapy in Jupyter Notebook enhancement gsoc-candidate

#4299 opened Feb 4, 2020 by Gallaecio

Merge Slot classes back? cleanup discuss

#4296 opened Jan 31, 2020 by wRAR

Document async signal handlers docs

#4295 opened Jan 31, 2020 by wRAR

1 11

Exceptions in middleware don't return exit code 1 in `scrapy crawl` & `scrapy check`

#4292 opened Jan 28, 2020 by dpfeif

Fatal error launching scrapy>1.6.0 from Anaconda Prompt bug install

#4289 opened Jan 26, 2020 by pwinzer

Fix "Debugging memory leaks with Guppy" section (docs) bug docs good first issue

#4285 opened Jan 24, 2020 by noviluni

Uses ipdb instead pdb when package installed enhancement

#4284 opened Jan 23, 2020 by jeanmask

process_spider_output called twice when exception occurs docs enhancement

#4266 opened Jan 3, 2020 by StasDeep

defer.inlineCallbacks in spider ? docs enhancement

#4263 opened Jan 1, 2020 by HelloEdit

Settings, multiple concurrent spiders, and middlewares docs enhancement

#4253 opened Dec 23, 2019 by mredaelli

Batch deliveries for long running crawlers enhancement

#4250 opened Dec 19, 2019 by ejulio

Previous 1 2 3 4 5 … 17 18 Next

Previous Next

ProTip! Exclude everything labeled bug with -label:bug.