Flat-File Access
With flat-file access, you can use standard S3 tools, for example AWS CLI and boto3, to read CryptoHFTData files directly. Make temporary credentials in your dashboard. Then list or download files from the bucket.
Standard S3 Tools
Use AWS CLI, boto3 or any S3-compatible client. You do not have to write file URLs manually.
Temporary Credentials
Each request from the dashboard gives temporary credentials. These credentials expire automatically after a limited time.
Direct Object Access
List the dataset prefixes and download files directly from the shared dataset bucket.
How It Works
- Log in to your account.
- Open your dashboard.
- If necessary, make or show your standard CryptoHFTData API key.
- In the API Keys section, click Generate S3 Credentials.
- Copy the endpoint, the bucket and the three fields of the temporary credentials.
- Use these values with AWS CLI or
boto3until they expire.
Differences from the REST API
REST Download Procedure
This procedure is best when you want one authenticated HTTP endpoint and you know the exact file path that you need.
Flat-File S3 Procedure
This procedure is best when you want the standard behavior of an S3 client. For example, you can list the bucket, examine the prefixes and connect directly to your object storage tools.
Credential Expiry
Temporary S3 credentials expire automatically. If AWS CLI or boto3 shows authentication errors, make a new set of credentials in the dashboard.