Scrapy 2.6 Documentation
URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore >= 1.4.87 The AWS credentials can be passed as user/password in the the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY • AWS_SESSION_TOKEN (only needed for temporary security credentials) You can also define a a custom ACL and custom endpoint for exported feeds using this setting: • FEED_STORAGE_S3_ACL • AWS_ENDPOINT_URL This storage backend uses delayed file delivery. Google Cloud Storage (GCS) New in0 码力 | 384 页 | 1.63 MB | 1 年前3Scrapy 2.10 Documentation
URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: boto3 >= 1.20.0 The AWS credentials can be passed as user/password in the the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY • AWS_SESSION_TOKEN (only needed for temporary security credentials) You can also define a custom endpoint, and region name for exported feeds using these settings: • FEED_STORAGE_S3_ACL • AWS_ENDPOINT_URL • AWS_REGION_NAME The default value for the overwrite key in the FEEDS for this storage backend0 码力 | 419 页 | 1.73 MB | 1 年前3Scrapy 1.7 Documentation
stored on Amazon S3. • URI scheme: s3 • Example URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv 3.8. Feed exports 85 Scrapy Documentation, Release 1.7.4 3) or boto (Python 2 only) The AWS credentials can be passed as user/password in the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY You can also that the component must be enabled in order for the setting to have any effect. AWS_ACCESS_KEY_ID Default: None The AWS access key used by code that requires access to Amazon Web services, such as the0 码力 | 306 页 | 1.23 MB | 1 年前3Scrapy 1.8 Documentation
stored on Amazon S3. • URI scheme: s3 • Example URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore (Python 2 and Python Documentation, Release 1.8.4 The AWS credentials can be passed as user/password in the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY You can also effect. AWS_ACCESS_KEY_ID Default: None The AWS access key used by code that requires access to Amazon Web services, such as the S3 feed storage backend. AWS_SECRET_ACCESS_KEY Default: None The AWS secret0 码力 | 335 页 | 1.44 MB | 1 年前3Scrapy 2.6 Documentation
change the export format (XML or CSV, for example) or the storage backend (FTP or Amazon S3 [https://aws.amazon.com/s3/], for example). You can also write an item pipeline to store the items in a database S3 The feeds are stored on Amazon S3 [https://aws.amazon.com/s3/]. URI scheme: s3 Example URIs: s3://mybucket/path/to/export.csv s3://aws_key:aws_secret@mybucket/path/to/export.csv Required external com/boto/botocore] >= 1.4.87 The AWS credentials can be passed as user/password in the URI, or they can be passed through the following settings: AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY AWS_SESSION_TOKEN (only needed0 码力 | 475 页 | 667.85 KB | 1 年前3Scrapy 2.7 Documentation
change the export format (XML or CSV, for example) or the storage backend (FTP or Amazon S3 [https://aws.amazon.com/s3/], for example). You can also write an item pipeline to store the items in a database S3 The feeds are stored on Amazon S3 [https://aws.amazon.com/s3/]. URI scheme: s3 Example URIs: s3://mybucket/path/to/export.csv s3://aws_key:aws_secret@mybucket/path/to/export.csv Required external com/boto/botocore] >= 1.4.87 The AWS credentials can be passed as user/password in the URI, or they can be passed through the following settings: AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY AWS_SESSION_TOKEN (only needed0 码力 | 490 页 | 682.20 KB | 1 年前3Scrapy 1.6 Documentation
s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore (Python 2 and Python 3) or boto (Python 2 only) The AWS credentials can be passed as as user/password in the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY Standard output The feeds are written to the standard output of the Scrapy effect. AWS_ACCESS_KEY_ID Default: None The AWS access key used by code that requires access to Amazon Web services, such as the S3 feed storage backend. AWS_SECRET_ACCESS_KEY Default: None The AWS secret0 码力 | 295 页 | 1.18 MB | 1 年前3Scrapy 2.7 Documentation
URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore >= 1.4.87 The AWS credentials can be passed as user/password in the the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY • AWS_SESSION_TOKEN (only needed for temporary security credentials) You can also define a a custom ACL and custom endpoint for exported feeds using this setting: • FEED_STORAGE_S3_ACL • AWS_ENDPOINT_URL This storage backend uses delayed file delivery. Google Cloud Storage (GCS) New in0 码力 | 401 页 | 1.67 MB | 1 年前3Scrapy 2.9 Documentation
URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore >= 1.4.87 The AWS credentials can be passed as user/password in the the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY • AWS_SESSION_TOKEN (only needed for temporary security credentials) You can also define a a custom ACL and custom endpoint for exported feeds using this setting: • FEED_STORAGE_S3_ACL • AWS_ENDPOINT_URL This storage backend uses delayed file delivery. Google Cloud Storage (GCS) New in0 码力 | 409 页 | 1.70 MB | 1 年前3Scrapy 2.8 Documentation
URIs: – s3://mybucket/path/to/export.csv – s3://aws_key:aws_secret@mybucket/path/to/export.csv • Required external libraries: botocore >= 1.4.87 The AWS credentials can be passed as user/password in the the URI, or they can be passed through the following settings: • AWS_ACCESS_KEY_ID • AWS_SECRET_ACCESS_KEY • AWS_SESSION_TOKEN (only needed for temporary security credentials) You can also define a a custom ACL and custom endpoint for exported feeds using this setting: • FEED_STORAGE_S3_ACL • AWS_ENDPOINT_URL This storage backend uses delayed file delivery. Google Cloud Storage (GCS) New in0 码力 | 405 页 | 1.69 MB | 1 年前3
共 61 条
- 1
- 2
- 3
- 4
- 5
- 6
- 7