Skip to main content

Singlestore database | pipeline on Activescale S3 bucket

Singlestore database on Activescale S3 bucket:

CREATE DATABASE <DB_NAME> ON S3 "<BucketName>"
CONFIG '{"compatibility_mode": true, "endpoint_url": "http://<endpointName>"}'
CREDENTIALS '{"aws_access_key_id":"<yourKey>","aws_secret_access_key":"<yourAccesKey>"}';

You might have faced following error while creating Singlestore database having files on S3 bucket on Activscale.

" The AWS Access Key Id you provided does not exist in our records. "

Create Database Pipeline:

CREATE PIPELINE library
AS LOAD DATA S3 '<bucketName>'
CONFIG '{"compatibility_mode": true, "endpoint_url": "http://<endpointName>"}'
CREDENTIALS '{"aws_access_key_id": "<yourKey>", "aws_secret_access_key": "<yourKey>"}'
INTO TABLE `<tableName>`
FIELDS TERMINATED BY ',';

When CSV files are copied to the S3 bucket data will be inserted ino to the table itself, no action is required. 





 



Labels:
Location: San Francisco, CA, USA

Comments

Post a Comment

Popular posts from this blog

MySQL InnoDB cluster troubleshooting | commands

Cluster Validation: select * from performance_schema.replication_group_members; All members should be online. select instance_name, mysql_server_uuid, addresses from  mysql_innodb_cluster_metadata.instances; All instances should return same value for mysql_server_uuid SELECT @@GTID_EXECUTED; All nodes should return same value Frequently use commands: mysql> SET SQL_LOG_BIN = 0;  mysql> stop group_replication; mysql> set global super_read_only=0; mysql> drop database mysql_innodb_cluster_metadata; mysql> RESET MASTER; mysql> RESET SLAVE ALL; JS > var cluster = dba.getCluster() JS > var cluster = dba.getCluster("<Cluster_name>") JS > var cluster = dba.createCluster('name') JS > cluster.removeInstance('root@<IP_Address>:<Port_No>',{force: true}) JS > cluster.addInstance('root@<IP add>,:<port>') JS > cluster.addInstance('root@ <IP add>,:<port> ') JS > dba.getC...
Post a Comment
Read more

MySQL 5.7 Install | Configure MySQL | Configure MySQL Replication | Configure systemd for single instance

Install MySQL 5.7 Community Edition on Linux: #yum install mysql80-community-release-el7-1.noarch.rpm #yum install mysql-community-server #yum install perl-DBD-MySQL-4.023-6.el7.x86_64.rpm #yum install percona-release-0.1-4.noarch.rpm Increase no. of open files: Edit file /etc/security/limits.conf and includes as follows, which will increase no of open files for mysql user to 65535 from 1024 which is default. excute ulimit -a after sudo to mysql, if you are logged in exit and login again then and then only you will be able to see it. mysql              soft     nofile           65535 mysql             hard     nofile           65535 Ref.: https://dev.mysql.com/doc/refman/8.0/en/linux-installation-yum-repo.html https://jinyuwang.weebly.co...
1 comment
Read more

Create MySQL database with hyphen

Create MySQL database with hyphen: If you are trying to create MySQL database with hyphen " - " in the name such as test-db and get error  " your MySQL server version for the right syntax to use near '-db' at line" then you might be wondering how to get it done as your business require MySQL database name with hyphen " - "  Here is the fix, use escape character " ` " before and after database name such as `test-db` and you will be able to create database with hyphen. CREATE DATABASE `test-db`; 
Post a Comment
Read more