Amir

Responsible for enforcing row level secured access by implementing secured views and data shares in Snowflake, writing Matillion ETL jobs to load data into Snowflake dimensions and fact tables, implementing scenarios to deleted employee data after 7 years of termination in Matillion/Grid variables, and analyzing incoming data files from 7 different Human Resource systems on Azure blob storage.

Data transformation from MS Excel, Google sheets, ERP systems to Google BigQuery using Matillion ETL in GCP. Coding Matillion ETL jobs to load data into GCP/BigQuery from on premises database. Running queries in GCP/Google BigQuery and landing output in Qlik for reporting. Analyzing sales reports data related to sales telephone calls, Web based inquiries, and chats. Analyzing reports in Excel and Google sheets to create Qlik dashboard. Data mapping, analysis, system configuration and evaluating the current state of the system to build a new Business Intelligence platform.

Data transformation from Azure blob storage files, SQL Server, Oracle ERP systems to Snowflake/Azure utilizing Matillion. Coding Matillion ETL jobs to load data into Snowflake/Azure. Running queries in GCP/Google BigQuery and landing output in Qlik for reporting. Analyzing HR employee related data and creating BI reports. Data analysis, system analysis, and evaluating the current state of the system to build a new Star Schema in Snowflake.

Migrating Data from Manhattan WMS ERP system to Netezza warehouse using DataStage 11.x. Architecting/Implementing ETL jobs with new implementation of Manhattan WMS system to existing Netezza based warehouse using DataStage 11.x. Designed and coded IBM BigIntegrate/Hadoop big data jobs. Architected ETL framework in DataStage 11.x to replace the existing FastReader ETL framework. Data modeling/architecting with MongoDB 4.x. Creating ETL jobs to generate JSON files to be loaded in MongoDB. Troubleshooted ETL scripts for moving data from Manhattan WMS 2018 to Netezza 7.2 & IBM IIAS(BLU DB). Upgrading and creating UNIX ETL scripts for FastReader. Loading data into AWS Snowflakes through DataStage 11.x. POC for loading data using Matillion on AWS to Snowflake.

Architect/design big data Hadoop ETL jobs to load data into Hive and HDFS files running in IBM BigIntegrate environment. Using hierarchical Stage in DataStage 11.x to generate JSON files to be loaded in MongoDB 4.x. Troubleshooting MongoDB loads. Designing collections and documents in MongoDB using different patterns. Using JavaScript aggregating framework to query MongoDB. Data mappings for source AS400/RPG system and target Manhattan Warehouse systems 2018. High Level and Low level technical and functional documents. Loading data into AWS/Snowflake through DataStage 11.x. Co-ordination/leading the effort of configuring the systems required for end-to-end data migration. DataStage 11.x ETL for loading data to Cloudera/Hadoop based HDFS files using JDBC. Architecting RMS (Retail Management System) ETL in Talend open studio 6.x.

Creating Functional and Technical documents per business requirements. Translating COBOL programs and creating ETL jobs to replace COBOL programs. Updating existing ETL to point to Netezza based EDW from Main Frame DB2. Data modeling and data analysis on DB2 and Netezza appliance base systems. Data and ETL architect responsibilities.

Data Analysis and Data modeling in ERWIN from home grown CRM to Informatica MDM Customer/Supplier 360. Converting DataStage ETL jobs into Web Services and deploying in ISD. Testing and troubleshooting issues related to Informatica MDM 8 and Informatica mappings. Data Analysis for Person, Organization, and Address entities in MDM for CRM and other homegrown CRM systems. IBM BigIntegrate to create/schedule Big Data ETL jobs. Architecting Cloudera/Hadoop data lake and creating ETL for loading data to Data Lake/HDFS files using JDBC drivers.

Data Analysis and Data modeling in ERWIN from home grown CRM to Informatica MDM Customer/Supplier 360. Converting DataStage ETL jobs into Web Services and deploying in ISD. Testing and troubleshooting issues related to Informatica MDM 8 and Informatica mappings. Data Analysis for Person, Organization, and Address entities in MDM for CRM and other homegrown CRM systems. IBM BigIntegrate to create/schedule Big Data ETL jobs. Architecting Cloudera/Hadoop data lake and creating ETL for loading data to Data Lake/HDFS files using JDBC drivers.

Creating technical documents for ETL to load MongoDB 3.x. Modeling and architecting data on MongoDB 3.x. Designing State compliance reports for insurance industry for the state of GA and ND. Creating design documents for ETL development and Business Objects Reports. Creating complex SQL queries analyzing data in Oracle and Netezza appliance. Meeting and providing guidelines to ETL developers and Business Objects developers. Generating test cases and providing queries for them. Gathering business requirements and creating functional requirements documentation.

Experience deploying/un-deploying InfoSphere 8.x/ETL jobs as web services in Information Services Director (ISD), which is IBM’s version of Data Virtualization. Troubleshooting SOA and WSDL related issues relating to Data Virtualization efforts. Designed and architected IBM BigIntegrate/Hadoop big data jobs. Administrating and troubleshooting with IBM BigIntegrate, Big data, HDFS, Hive and Impala database. Experience developing and deploying ETL jobs in InfoSphere ISD and generate WSDL files for other clients. Troubleshooting day-to-day activities on server related to ISD/ETL/Web Services/WSDL. Working with SOA team to help implement ETL processes as a web service. Creating DataStage ETL jobs to write flat data files and other RDBMS sources to write HDFS files on Cloudera Hadoop. Creating DataStage ETL jobs using JDBC to load Impala and Hive databases on Cloudera/Hadoop. Troubleshooting HDFS files and data related issues on Hadoop platform. Troubleshoot Data profiling activities related issues with Information Analyzer. Communicating with DB2 team to troubleshoot IADB related issues. Helped developers manage IADB Tables, Rules execution, Column Analysis, Data sources etc. ETL data integration experience across multiple RDBMS platforms. Designing/developing/implementing DataStage/QualityStage job and job sequences. Extensive experience integrating parameter sets/parameters and environment variables. Designed error-level/exception handling and debugging methodologies, data cleansing, and transformation expressions to account for both in and out of scope data. Interface with source files utilizing complex flat/sequential files, unstructured data, data/file sets with integration with DBMS systems utilizing Database connectors to include ODBC, DB2, and SYBASE ASE stages. Performed administrative activities such as Project/User creation, Roles Management, Import and Export projects, database configuration setup, dataset management, and QualityStage component. Worked with other Database and Unix administrators to resolve any open issues. Worked with Vendor to co-ordinate patch installations, upgrades, and IIS support packages. Co-ordinated backup and restore activities for the platform. Dealt with product vendors and technical specialists to resolve issues. Managed, supported, configured, installed, and upgraded IBM Information Server Environment version 8.5. Converting parallel jobs into Grid enabled job environment.Troubleshot BW, R3, IDoc and BAPI connectivity related issues on day to day basis. Educating ETL developers on how to implement Parallelism in high volume jobs. Code migration, Internal/External Audit requirements, Job logs archiving. Database connectivity setup (ODBC, LDAP and DB Client) and related issues. WPS, Web Services deployment. IBM, PMR, and patch applications. Mentoring junior programmers.