Skip to main content

Amazon Redshift Daily Command

Amazon Redshift Daily:

SELECT CURRENT_AWS_ACCOUNT;

SELECT CURRENT_DATABASE();

SELECT CURRENT_NAMESPACE();

SELECT CURRENT_SCHEMA();

SELECT CURRENT_USER_ID();

SELECT CURRENT_USER;

-- Metadata

select distinct(nspname) from pg_catalog.pg_namespace where nspname not like 'pg_temp%';

-- Describe Table

select * from information_schema.columns where table_name='columns';

select column_name, data_type, character_maximum_length from information_schema.columns where table_name='columns';

-- Create Read-only Group

Create group ro_group;

-- Create User

Crate user ro_user with password <password>;

-- Add user to Read-only Group

alter group ro_group ADD user ro_user;

-- Grant Usage permission to Read-Only Group to specific schema

grant usage on schema "ro_schema" to group ro_group;

-- Grant select permisson to read-only group to specific schema

grant select on all tables in schema "ro_schema" to group "ro_group";

-- Alter default privileges to maintain the permission on new tables

alter default privileges in schema "ro_schema" grant select on tables to group ro_group;

-- Revoke crate privileges from group

revoke create on schema "ro_schema" from group ro_group;

Example:

create group testgroup;

create user test1 password 'test123' in group testgroup;

grant usage on schema "rs_public" to group testgroup;

grant select on all tables in schema rs_public to group testgroup;

grant select on all tables in schema grant select on all tables in schema public to group data_viewers;

select * from pg_user where usename like 't%';

select groname from pg_catalog.pg_group pg where groname like 'test%';

select groname from pg_catalog.pg_group pg where groname like 'l%';

call rs_public.idm_ndew_revoke_from_login_role ('testgroup', 'test1');

grant all on procedure public. idm_new_revoke_from_login_role_bkup (in varchar, inout varchar) to test1;

create group testgroup;

create user test1 password 'test123' in group testgroup;

grant usage on schema "rs_public_ to group testgroup;

grant select on all tables in schema rs_public to group testgroup; 

Rename Table:

alter table db_name.schema_name.table_name rename to new_table_name;

Note: Remember not to include db_name.schema_name while giving new_table_name.

Troubleshoot ETL Extract and ETL Load:

To troubleshoot ETL Extract, and ETL Load query the system tables stl_load_errors, and stl_loaderror_detail;

select * from stl_load_errors;

select * from stl_loaderror_detail;

 

 

   

 

 


Comments

Popular posts from this blog

MySQL InnoDB cluster troubleshooting | commands

Cluster Validation: select * from performance_schema.replication_group_members; All members should be online. select instance_name, mysql_server_uuid, addresses from  mysql_innodb_cluster_metadata.instances; All instances should return same value for mysql_server_uuid SELECT @@GTID_EXECUTED; All nodes should return same value Frequently use commands: mysql> SET SQL_LOG_BIN = 0;  mysql> stop group_replication; mysql> set global super_read_only=0; mysql> drop database mysql_innodb_cluster_metadata; mysql> RESET MASTER; mysql> RESET SLAVE ALL; JS > var cluster = dba.getCluster() JS > var cluster = dba.getCluster("<Cluster_name>") JS > var cluster = dba.createCluster('name') JS > cluster.removeInstance('root@<IP_Address>:<Port_No>',{force: true}) JS > cluster.addInstance('root@<IP add>,:<port>') JS > cluster.addInstance('root@ <IP add>,:<port> ') JS > dba.getC...

Amazon RDS | Amzon Redshift | Big Data | Boost Performance with Amazon ElastiCache

Amazon RDS with Amazon ElastiCache for Performance: Amazon RDS supports - Oracle, MS SQL server, MySQL, Maria DB and PostgreSQL. It is a managed service offered by the Amazon.  Couple of customers have observed the performance issues during their journey with Amazon RDS with Oracle, MS SQL Server, MySQL, Maria DB and PostgreSQL. Amazon cloud engineers / database consultants / database architect and Amazon supports worked to-gather to boost the Amazon RDS performance by tuning the RDBMS configuration parameters using Amazon RDS parameter group , and have not achieved the SLA for Amazon RDS .  Amazon RDS with Multi AZ and Read Replica: Some of the the AWS professionals have suggested for vertical scaling of the Amazon RDS . It should works and its absolutely correct. In my opinion, it would be a good idea to think about the Amazon ElastiCache service with Amazon RDS for better performance and cost optimization also rather than vertically scaling the Amazon RDS . I would sug...

Needs for Graph Database

Needs for Graph Database: We are living in the era of data, data is treated more precise than gold and platinum. Most of the enterprises are trying to get more insight about the data they have it as an operational / warehouse / analytical.   Ref.: https://dist.neo4j.com/wp-content/uploads/graph-example.png To get more insight into the data, it is required to see the relationship among the data points. The challenge is how to establish the relationship among data points and the answers is Graph database. Relational databases can't help to establish the relationship among data points, due to their rigid schema, and consistent schema. Relational Database issues for data set: Number of Joins:  While fetching data from relational databases, we join many tables, these joins are complex, and consume considerable amount of computing resources, which increase the query response times. Self- joins: For database ware house / business intelligence systems using RDBMS, self-JOIN are ...