background preloader

RDS-Tools

Facebook Twitter

AmazonRDSMigrationToolUserGuide. Create a Hive Metastore Outside the Cluster - Amazon Elastic MapReduce. Hive records metastore information in a MySQL database that is located, by default, on the master node.

Create a Hive Metastore Outside the Cluster - Amazon Elastic MapReduce

The metastore contains a description of the input data, including the partition names and data types, contained in the input files. When a cluster terminates, all associated cluster nodes shut down. All data stored on a cluster node, including the Hive metastore, is deleted. Information stored elsewhere, such as in your Amazon S3 bucket, persists. If you have multiple clusters that share common data and update the metastore, you should locate the shared metastore on persistent storage. To share the metastore between clusters, override the default location of the MySQL database to an external persistent storage location. Note Hive neither supports nor prevents concurrent write access to metastore tables. Importing Data From Any Source to a MySQL DB Instance - Amazon Relational Database Service. If you have more than 1GB of data to load, or if your data is coming from somewhere other than a MySQL database, we recommend creating flat files and loading them with mysqlimport. mysqlimport is another command line utility bundled with the MySQL client software whose purpose is to load flat files into MySQL.

Importing Data From Any Source to a MySQL DB Instance - Amazon Relational Database Service

For information about mysqlimport, go to mysqlimport - A Data Import Program in the MySQL documentation. We also recommend creating DB Snapshots of the target Amazon RDS DB instance before and after the data load. Download Oracle 11g release 2 client ODBC drivers - ConnectionStrings.com. At the download pages there is a requirement to accept the OTN license agreement.

Download Oracle 11g release 2 client ODBC drivers - ConnectionStrings.com

At the top of the page, click the "Accept License Agreement" radio before clicking download. 32-bit Windows Go to Download win3211gR2client.zipExtract the zip file.Open the "Client" directory.Launch the "Oracle Client Installer" by clicking setup.exe. Done. Back to driver info page → 64-bit Windows. Working with DB Security Groups - Amazon Relational Database Service. A DB security group controls network access to a DB instance that is not inside a VPC.

Working with DB Security Groups - Amazon Relational Database Service

By default, network access is turned off to a DB instance. You can specify rules in a security group that allows access from an IP address range, port, or EC2 security group. Once ingress rules are configured, the same rules apply to all DB instances that are associated with that security group. Amazon RDS Security Groups - Amazon Relational Database Service.

Security groups control the access that traffic has in and out of a DB instance.

Amazon RDS Security Groups - Amazon Relational Database Service

Three types of security groups are used with Amazon RDS: DB security groups, VPC security groups, and EC2 security groups. In simple terms, a DB security group controls access to a DB instance that is not in a VPC, a VPC security group controls access to a DB instance (or other AWS instances) inside a VPC, and an EC2 security group controls access to an EC2 instance. By default, network access is turned off to a DB instance.

You can specify rules in a security group that allows access from an IP address range, port, or EC2 security group. Once ingress rules are configured, the same rules apply to all DB instances that are associated with that security group. Connecting to Amazon RDS Databases from Eclipse - AWS Developer Blog - Java. Connecting to a RDS Server from a Local Computer Using SSH Tunneling on a Mac. That was the google query I searched and it took me a long time to find an answer so I’m going to contribute it back to the internet.

Connecting to a RDS Server from a Local Computer Using SSH Tunneling on a Mac

Most helpful resources: (almost helpful: ) Problem I wanted to connect to a remote RDS instance from my mac computer. You normally would connect through an ec2 instance so do things differently, but if you want to connect from your local computer, the permissions make this a bit challenging. Amazon RDS supports the following access scenarios.

For more detail on what you need to do to successfully address each scenario, see the documentation section given. Virtual Private Clouds (VPCs) and Amazon RDS - Amazon Relational Database Service. Unless you are working with a legacy DB instance, your DB instance is in a virtual private cloud (VPC).

Virtual Private Clouds (VPCs) and Amazon RDS - Amazon Relational Database Service

A virtual private cloud is a virtual network that is logically isolated from other virtual networks in the AWS cloud. Amazon Virtual Private Cloud (Amazon VPC) lets you launch AWS resources, such as an Amazon Relational Database Service (Amazon RDS) or Amazon Elastic Compute Cloud (Amazon EC2) instance, into a VPC. The VPC can either be a default VPC that comes with your account or one that you create. All VPCs are associated with your AWS account. Remotely connect to an AWS RDS instance using MySQL Workbench. How to connect and send SQL queries remotely to an Amazon Web Service RDS instance using MySQL Workbench After having created a new Amazon Web Service RDS instance it's often useful to have access to it remotely to send SQL command.

Remotely connect to an AWS RDS instance using MySQL Workbench

By default a newly created RDS instance will deny any connection. So the first step is to create a new security rule (or edit an existing one) and add your IP address to gain access to the instance. Navigate to the RDS console: Then head to the security group screen, select or create a new security group: And add your public IP address (don't forget to add the subnet mask for example /32 after the host).

Then we'll need to figure out what is the instance address, to do so go to the instance menu and write down the endpoint, port number and principal username: Developer Zone. Connecting to a DB Instance Running the MySQL Database Engine - Amazon Relational Database Service. Once Amazon RDS provisions your DB instance, you can use any standard MySQL client application or utility to connect to the instance.

Connecting to a DB Instance Running the MySQL Database Engine - Amazon Relational Database Service

In the connection string, you specify the DNS address from the DB instance endpoint as the host parameter, and specify the port number from the DB instance endpoint as the port parameter. You can use the AWS Management Console, the rds-describe-db-instances CLI command, or the DescribeDBInstances API action to list the details of an Amazon RDS DB instance, including its endpoint. If an endpoint value is myinstance.123456789012.us-east-1.rds.amazonaws.com:3306, then you would specify the following values in a MySQL connection string: For host or host name, specify myinstance.123456789012.us-east-1.rds.amazonaws.comFor port, specify 3306.