Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA
Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com
2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
DynamoDB Connector User Guide V1.0
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
1. Introduction
Informatica Cloud Connector SDKs are off-cycle, off-release add-ins that provide connectivity to SaaS and on-premise applications not supported natively in Informatica Cloud. Connector SDKs can be enabled anytime for your cloud org Id, and are designed to address common use cases including getting data into, and out of, the supported application.
Connector SDKs do not require any separate software installation on the machine running the Informatica Cloud Secure Agent. The Connector uses an internal Java application to communicate with the Secure Agent, as shown in the architecture diagram below:
Once you have enabled the Connector Package software for your org Id, you need to create a connection in Informatica Cloud to access to the DynamoDB.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
2. Technologies Connector is developed using - JDK 1.7, AWS SDK 1.7.3 3. High level Architectural Diagram
Compatibility: This connector supports DynamoDB Table services.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
4. DynamoDB Assumptions/Prerequisites
DynamoDB connector requires an account with Amazon cloud web service enabled
Access Key and secret Key also required to connect the Amazon DynamoDB.
Note: This list is just example of tables in DynamoDB; user can have any number of tables in the Amazon DynamoDB.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
6. Creating DynamoDB Connection Before you use the DynamoDB connector in a data synchronization task, you must follow these steps to create a connection in Informatica Cloud: 1. Click on the Configuration tab. 2. Click on the Connections page. 3. Click the New button. Connection Property Description Connection Name (Mandatory) Provide the Name of the connection Description (optional) Provide the description Type (Mandatory) Select DynamoDB (Informatica Cloud) Secure Agent (Mandatory) Secure Agent that Informatica Cloud uses to access the Web Service. Access Key (Mandatory) Provide the Access Key of Amazon S3 for your account Secret Key (Mandatory) Provide secret key of Amazon S3 for your account Region (optional) Select the region
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
7. Target Creation
Before click Create Target in DSS task step-3, user should make sure the HashKey & RangeKey column & data type, read throughput and write throughput configuration made as below,
1. Open dynamoDB.properties file under both below 2 path 2. <Agent_Installed_Direcotry>\main\tomcat\plugins\519000 3. <Agent_Installed_Direcotry>\main\bin\rdtm\javalib\519000 4. Provide the value for HashKey, RangeKey, HashKey_DT, RangeKey_DT, Read_Throuhput and Write_Throughput as below, HashKey= ID (Primary key from source system-mandatory) RangeKey= Name (Unique column from source system) HashKey_DT=S (Data type can be only S, N or B) RangeKey_DT=S (Data type can be only S, N or B) Read_Throuhput=1 (Read capacity unit) Write_Throughput=1 (Write capacity unit) .
Please refer the screen shot
Note: HashKey & RangeKey column name should not contain the space or special character other than underscore (_)
Field mapping should be proper in the field mapping page before Save & Run the task.
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
Please refer the field mapping screenshot
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
8. Supported Data filter
All data filter option are supported in Data Filter page except below option Is Null Is Not Null
9. Connector Read notes
1. DynamoDB read methods returns entire records or number of records by given batch Size as Runtime time attribute in DSS task step-6 2. Read & Write throughput can be set as Runtime attribute at DSS task step-6
3. Throughput value for both Read Capacity Unit & Write Capacity Unit should not be less than 1
4. Throughput value for both Read Capacity Unit & Write Capacity Unit can be increased by maximum100% from the current throughput value in the table. (Ex: current value: 5, new value 10 by max)
10. Connector Write notes
1. Read & Write throughput can be set as Runtime attribute at DSS task step-6
2. HashKey column & RangeKey column mapping are mandatory and should be correct for Create, Update, Upsert & Delete operations.
3. Throughput value for both Read Capacity Unit & Write Capacity Unit should not be less than 1
4. Throughput value for both Read Capacity Unit & Write Capacity Unit can be increased by maximum 100% from the current throughput value in the table. (Ex: current value: 5, new value can be10 by max)
Informatica Worldwide Headquarters, 100 Cardinal Way, Redwood City, California 94063, USA Phone: toll-free in the US: 1.800.653.3871 www.InformaticaCloud.com 2011 Informatica Corporation. All rights reserved. Informatica and the Informatica logo are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners.
11. Assumptions & Limitations
1. Connector supports and compatible only for DynamoDB 2. An Amazon web service user account with Access Key and Secret Key are required to make the connection and perform the CRUD operation. 3. User has to provide Hashkey & RangeKey mapping, data type and through put value to create a new table in DynamoDB by using Create Target option in DSS-Task-3. 4. Filed mapping & data should be proper and appropriate to perform CRUD operation.