Skip to content

Commit 42125cd

Browse files
anoop-singh1anoop-singh1
committed
Data Migrator initial checkin
0 parents  commit 42125cd

File tree

88 files changed

+10151
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

88 files changed

+10151
-0
lines changed

‎.classpath

+8
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<classpath>
3+
<classpathentry kind="con" path="org.eclipse.jdt.launching.JRE_CONTAINER"/>
4+
<classpathentry kind="src" path="datamigrator-core/src/main/java"/>
5+
<classpathentry kind="src" path="datamigrator-core/src/test/java"/>
6+
<classpathentry kind="src" path="datamigrator-module/src/main/java"/>
7+
<classpathentry kind="output" path="bin"/>
8+
</classpath>

‎.gitignore

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
.DS_Store
2+
bin/
3+
target/
4+
*.log
5+

‎.project

+23
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<projectDescription>
3+
<name>datamigrator</name>
4+
<comment></comment>
5+
<projects>
6+
</projects>
7+
<buildSpec>
8+
<buildCommand>
9+
<name>org.eclipse.jdt.core.javabuilder</name>
10+
<arguments>
11+
</arguments>
12+
</buildCommand>
13+
<buildCommand>
14+
<name>org.eclipse.m2e.core.maven2Builder</name>
15+
<arguments>
16+
</arguments>
17+
</buildCommand>
18+
</buildSpec>
19+
<natures>
20+
<nature>org.eclipse.m2e.core.maven2Nature</nature>
21+
<nature>org.eclipse.jdt.core.javanature</nature>
22+
</natures>
23+
</projectDescription>

‎.settings/org.eclipse.m2e.core.prefs

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
activeProfiles=
2+
eclipse.preferences.version=1
3+
resolveWorkspaceProjects=true
4+
version=1

‎README.md

+126
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,126 @@
1+
# Data-Migration-Tool
2+
3+
*Data-Migration-Tool* is a tool that migrates the data from one Salesforce Org to another Salesforce Org.
4+
5+
Migrating data between orgs can be a daunting ask, this is specially true if you have a complex data model in the form of parent-child, hierarchical, lookups, record types etc relationships.
6+
7+
Doing so manually is error prone, time consuming, frustrating and not an ideal approach. We wrote a Java based tool using Salesforce SOAP to migrate the data from one Salesforce Org to another Salesforce Org. Org to Org Data Loader tool lets you migrate the data from one Salesforce Org to another Salesforce Org.
8+
9+
## Build Org To Org Data Loader
10+
11+
#### Tool has two modules.
12+
13+
* datamigrator-core: This module has tools core classes
14+
* datamigrator-module: This module has sample examples on how the tool can be used to migrate different kind of related objects from one Salesforce org to another Salesforce org. *datamigrator-module* contains sample JSON object relationship mappings.
15+
16+
#### Build
17+
git clone [email protected]:forcedotcom/Data-Migration-Tool.git
18+
mvn clean install
19+
20+
#### Usage: Migrate Products, Pricebooks and PricebookEntries Sample
21+
22+
Enter Source and Target org credentials in *build.properties*
23+
mvn clean install
24+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateProducts" -pl datamigrator-module
25+
26+
## Running in your IDE
27+
28+
### Overview
29+
30+
You can load the project into your IDE and run the main class to kick-off the migration. We recommend using [Eclipse](http://www.eclipse.org/downloads/). Because this tool is a standard Maven project, you can import it into your IDE using the root `pom.xml` file. In Eclipse, choose Open from the File menu -> Import -> Maven -> and select `Existing Maven Projects` -> select the the root folder.
31+
32+
After opening the project in Eclipse, you will see below two modules:
33+
34+
* datamigrator-core: This module has tools core classes
35+
* datamigrator-module: Contains the mapping and main java classes to run the migration
36+
37+
Tool comes with many main classes as a way to show different kind of mappings and migrations:
38+
39+
* Main Class: `migrator.module.client.Migrate`
40+
* Main Class: `migrator.module.client.MigrateProducts`
41+
* Main Class: `migrator.module.client.MigrateAll`
42+
* Main Class: `migrator.module.client.MigrateMasterDetail`
43+
44+
and many more...
45+
46+
47+
## Running using command line (More Sample Migrations...)
48+
49+
Migrate a simple object's records (no relationships)
50+
51+
Edit the object-mappings/Products.json with your object API name, save
52+
53+
mvn exec:java -Dexec.mainClass="migrator.module.client.Migrate" -pl datamigrator-module
54+
55+
Migrate object's with masterdetail relationships
56+
57+
Edit the object-mappings/Masterdetail_mapping.json with your object API names, save
58+
59+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateMasterDetail" -pl datamigrator-module
60+
61+
Migrate object's with hierarchical relationships
62+
63+
Edit the object-mappings/Hierarchical_mapping.json with your object API names, save
64+
65+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateHierarchical" -pl datamigrator-module
66+
67+
OR
68+
69+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateAccountsHierarchical" -pl datamigrator-module
70+
71+
72+
Migrate multiple object's in a single run
73+
74+
Edit the object-mappings as referenced in MigrateAll.java with your object API names, save
75+
76+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateAll" -pl
77+
datamigrator-module
78+
79+
Migrate Accounts with Opportunities and Assets. Make sure you edit the JSON with your external ids from Accounts with Opportunities and Assets objects.
80+
81+
Edit the object-mappings/AccountwithAssetsAndOppties_hierarchical.json with your object's external Id API name, save
82+
83+
mvn exec:java -Dexec.mainClass="migrator.module.client.MigrateAccountsHierarchical" pl datamigrator-module
84+
85+
86+
## Usage (Sample Deletions from Target Org)
87+
88+
Delete a simple object's records
89+
90+
Edit the object-mappings/Products.json with your object API name, save
91+
92+
mvn exec:java -Dexec.mainClass="migrator.module.client.Delete" -pl datamigrator-module
93+
94+
Delete multiple object's records in a single run
95+
96+
Edit the object-mappings as referenced in DeleteAll.java with your object API names, save
97+
98+
mvn exec:java -Dexec.mainClass="migrator.module.client.DeleteAll" -pl datamigrator-module
99+
100+
101+
## Usage (Compare objects metadata in source and target org)
102+
103+
Compare objects Metadata in source and target org
104+
105+
mvn exec:java -Dexec.mainClass="migrator.module.client.MetadataCompareExample" object1,object2 -pl datamigrator-module
106+
107+
## Usage (Given a set of objects, create a JSON mapping structure)
108+
109+
Given a set of objects, create a JSON mapping structure
110+
111+
mvn exec:java -Dexec.mainClass="migrator.module.client.GenerateMappingExample" object1,object2 -pl datamigrator-module
112+
113+
## Usage (Counts the number of records in source and target org)
114+
115+
Once migration has completed, you may want to compare the number of records in source and target org
116+
117+
mvn exec:java -Dexec.mainClass="migrator.module.client.ValidateExample" object1,object2 -pl datamigrator-module
118+
119+
120+
# More Advanced Object Relationship JSON Mappings, Resources
121+
122+
For more information, see the [wiki](https://github.com/forcedotcom/Data-Migration-Tool/wiki)
123+
124+
## Authors
125+
126+
Anoop Singh by [Anoop Singh](mailto:[email protected], [email protected])

‎datamigrator-core/.classpath

+31
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<classpath>
3+
<classpathentry kind="src" output="target/classes" path="src/main/java">
4+
<attributes>
5+
<attribute name="optional" value="true"/>
6+
<attribute name="maven.pomderived" value="true"/>
7+
</attributes>
8+
</classpathentry>
9+
<classpathentry excluding="**" kind="src" output="target/classes" path="src/main/resources">
10+
<attributes>
11+
<attribute name="maven.pomderived" value="true"/>
12+
</attributes>
13+
</classpathentry>
14+
<classpathentry kind="src" output="target/test-classes" path="src/test/java">
15+
<attributes>
16+
<attribute name="optional" value="true"/>
17+
<attribute name="maven.pomderived" value="true"/>
18+
</attributes>
19+
</classpathentry>
20+
<classpathentry kind="con" path="org.eclipse.jdt.launching.JRE_CONTAINER/org.eclipse.jdt.internal.debug.ui.launcher.StandardVMType/JavaSE-1.8">
21+
<attributes>
22+
<attribute name="maven.pomderived" value="true"/>
23+
</attributes>
24+
</classpathentry>
25+
<classpathentry kind="con" path="org.eclipse.m2e.MAVEN2_CLASSPATH_CONTAINER">
26+
<attributes>
27+
<attribute name="maven.pomderived" value="true"/>
28+
</attributes>
29+
</classpathentry>
30+
<classpathentry kind="output" path="target/classes"/>
31+
</classpath>

‎datamigrator-core/.gitignore

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
/target/

‎datamigrator-core/.project

+23
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<projectDescription>
3+
<name>datamigrator-core</name>
4+
<comment></comment>
5+
<projects>
6+
</projects>
7+
<buildSpec>
8+
<buildCommand>
9+
<name>org.eclipse.jdt.core.javabuilder</name>
10+
<arguments>
11+
</arguments>
12+
</buildCommand>
13+
<buildCommand>
14+
<name>org.eclipse.m2e.core.maven2Builder</name>
15+
<arguments>
16+
</arguments>
17+
</buildCommand>
18+
</buildSpec>
19+
<natures>
20+
<nature>org.eclipse.jdt.core.javanature</nature>
21+
<nature>org.eclipse.m2e.core.maven2Nature</nature>
22+
</natures>
23+
</projectDescription>

‎datamigrator-core/.settings/org.eclipse.jdt.core.prefs

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
eclipse.preferences.version=1
2+
org.eclipse.jdt.core.compiler.codegen.targetPlatform=1.8
3+
org.eclipse.jdt.core.compiler.compliance=1.8
4+
org.eclipse.jdt.core.compiler.problem.forbiddenReference=warning
5+
org.eclipse.jdt.core.compiler.source=1.8

‎datamigrator-core/.settings/org.eclipse.m2e.core.prefs

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
activeProfiles=
2+
eclipse.preferences.version=1
3+
resolveWorkspaceProjects=true
4+
version=1

‎datamigrator-core/pom.xml

+93
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,93 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
3+
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
4+
http://maven.apache.org/maven-v4_0_0.xsd">
5+
<modelVersion>4.0.0</modelVersion>
6+
7+
<parent>
8+
<groupId>datamigrator.main</groupId>
9+
<artifactId>datamigrator</artifactId>
10+
<version>0.0.1-SNAPSHOT</version>
11+
</parent>
12+
13+
<groupId>datamigrator.main</groupId>
14+
<version>0.0.1-SNAPSHOT</version>
15+
<artifactId>datamigrator-core</artifactId>
16+
<packaging>jar</packaging>
17+
<name>datamigrator-core</name>
18+
19+
<build>
20+
<plugins>
21+
<plugin>
22+
<artifactId>maven-compiler-plugin</artifactId>
23+
<version>2.0.2</version>
24+
<configuration>
25+
<source>1.8</source>
26+
<target>1.8</target>
27+
</configuration>
28+
</plugin>
29+
<plugin>
30+
<groupId>org.codehaus.mojo</groupId>
31+
<artifactId>exec-maven-plugin</artifactId>
32+
<configuration>
33+
<mainClass>datamigrator.core.MigrationProcess</mainClass>
34+
</configuration>
35+
</plugin>
36+
<plugin>
37+
<artifactId>maven-compiler-plugin</artifactId>
38+
<version>2.0.2</version>
39+
<configuration>
40+
<source>1.8</source>
41+
<target>1.8</target>
42+
</configuration>
43+
</plugin>
44+
<plugin>
45+
<groupId>org.codehaus.mojo</groupId>
46+
<artifactId>exec-maven-plugin</artifactId>
47+
<configuration>
48+
<mainClass>datamigrator.core.test.ValidatorExample</mainClass>
49+
</configuration>
50+
</plugin>
51+
</plugins>
52+
</build>
53+
54+
<dependencies>
55+
<dependency>
56+
<groupId>log4j</groupId>
57+
<artifactId>log4j</artifactId>
58+
<version>1.2.17</version>
59+
</dependency>
60+
<dependency>
61+
<groupId>org.slf4j</groupId>
62+
<artifactId>slf4j-api</artifactId>
63+
<version>1.7.7</version>
64+
</dependency>
65+
66+
<dependency>
67+
<groupId>org.slf4j</groupId>
68+
<artifactId>jcl-over-slf4j</artifactId>
69+
<version>1.7.7</version>
70+
</dependency>
71+
<dependency>
72+
<groupId>org.json</groupId>
73+
<artifactId>json</artifactId>
74+
<version>20090211</version>
75+
</dependency>
76+
<dependency>
77+
<groupId>commons-io</groupId>
78+
<artifactId>commons-io</artifactId>
79+
<version>2.5</version>
80+
</dependency>
81+
<dependency>
82+
<groupId>com.force.api</groupId>
83+
<artifactId>force-wsc</artifactId>
84+
<version>41.0.0</version>
85+
</dependency>
86+
<dependency>
87+
<groupId>com.force.api</groupId>
88+
<artifactId>force-partner-api</artifactId>
89+
<version>41.0.0</version>
90+
</dependency>
91+
92+
</dependencies>
93+
</project>

‎datamigrator-core/src/main/java/META-INF/MANIFEST.MF

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
Manifest-Version: 1.0
2+
Class-Path:
3+

0 commit comments

Comments
 (0)