Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upSave images on remote server #3928
Comments
|
I dont think scrapy support saving files, images to FTP servers except S3 or Google. |
|
Sorry, I missed the ‘images’ bit |
|
Hi @bezkos, we are also looking for the same kind of solution, do you mind sharing your class FTPStore ? That will be very helpfull |
class FTPStore(object):
FTP_USERNAME = None
FTP_PASSWORD = None
def __init__(self, uri):
assert uri.startswith('ftp://')
serverip = uri.split('://', 1)[1]
self.ftp = FTP()
# self.ftp.set_debuglevel(2)
self.ftp.connect(serverip, 21)
self.ftp.login(self.FTP_USERNAME, self.FTP_PASSWORD)
def persist_file(self, path, buf, info, meta=None, headers=None):
buf.seek(0)
self.ftp.storbinary('STOR %s' %path, buf)
def stat_file(self, path, info):
Custom code here cause i needed to download images only 1 time without expiration.
return {'last_modified': last_modified, 'checksum': path}Hope I helped... |
|
Working on that |
|
Kindly let me know if someone is still working on this if not please assign this to me. If someone is working on this can you tell me which "good first issues" (or easy ones ) are unclaimed yet I have tried to get one other before and that was already claimed by someone. Thank you in advance. |
See #3961 |
|
I will study codebase according to that @Gallaecio |
|
Is someone still working on this? |
|
I looked at the data base and tried to understand but for now I am not working on this issue and @Gallaecio will tell you if someone else is workkng on this issue |
I want to save images on a remote server via (FTP?). Is this possible with scrapy?
(I know about S3 or Google but i mean in a custom FTP server).