Getting Started with Talend Open Studio for Data I

Getting Started with Talend Open Studio for Data I - Opis

Talend Open Studio for Data Integration (TOS) is an open source graphical development environment for creating custom integrations between systems. It comes with over 600 pre-built connectors that make it quick and easy to connect databases, transform files, load data, move, copy and rename files and connect individual components in order to define complex integration processes.Getting Started with Talend Open Studio for Data Integration illustrates common uses and scenarios in a simple, practical manner and, building on knowledge as the book progresses, works towards more complex integration solutions.TOS is a code generator and so does a lot of the heavy liftingù for you. As such, it is a suitable tool for experienced developers and non-developers alike. You'll start by learning how to construct some common integrations tasks ñ transforming files and extracting data from a database, for example. These building blocks form a toolkitù of techniques that you will learn how to apply in many different situations.By the end of the book, once complex integrations will appear easy and you will be your organization's integration expert!Best of all, TOS makes integrating systems fun! Spis treści:
Getting Started with Talend Open Studio for Data Integration
Table of Contents
Getting Started with Talend Open Studio for Data Integration
Credits
Foreword
Foreword
About the Author
Acknowledgement
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why Subscribe?
Free Access for Packt account (...) więcej holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Knowing Talend Open Studio
What Talend Open Studio is
Use cases
History of Talend Open Studio
Benefits of Talend Open Studio
Installing Talend Open Studio
Prerequisites
Installation guide
Other useful software
Text editor
MySQL
Sample jobs and data
Summary
2. Working with Talend Open Studio
Studio definitions
Starting the Studio
Tour of the Studio
The Repository
The design workspace
The Palette
Configuration tabs
Outline and Code panels
Creating a new project
Creating an example job
Metadata
Summary
3. Transforming Files
Transforming XML to CSV
Transforming CSV to XML
Maps and expressions
Advanced XML output for complex XML structures
Working with multi-schema XML files
Enriching data with lookups
Extracting data from Excel files
Extracting data from multiple sheets
Joining data from multiple sheets
Summary
4. Working with Databases
Database metadata
Extracting data from a database
Extracts from multiple tables
Joining within the database component
Joining outside the database component
Writing data to a database
Database to database transfer
Modifying data in a database
Dynamic database lookup
Summary
5. Filtering, Sorting, and Other Processing Techniques
Filtering data
Simple filter
Filter and rejects
Filter and split
Sorting data
Aggregating data
Normalizing and denormalizing data
Data normalization
Data denormalization
Extracting delimited fields
Find and replace
Sampling rows
Summary
6. Managing Files
Managing local files
Copying files
Copying and removing files
Renaming files
Deleting files
Timestamping a file
Listing files in a directory
Checking for files
Archiving and unarchiving files
FTP file operations
FTP Metadata
FTP Put
FTP Get
FTP File Exist
FTP File List and Rename
Deleting files on an FTP server
Summary
7. Job Orchestration
What is a subjob
A simple subjob
On Subjob Error
On Component OK
Run If
Jobs as subjobs
Iterating and looping
Iterate connections
ForEach loop
Loop "n" times
Infinite loop
Duplicating and merging dataflows
Duplicating data
Merging data
Summary
8. Managing Jobs
Job versions
Exporting and importing jobs
Exporting jobs
Exporting a project
Exporting a job
Exporting a job for execution
Importing jobs
Importing a project
Importing a job
Scheduling jobs
Summary
9. Global Variables and Contexts
Global variables
Studio global variables
User defined global variables
Contexts
Embedded context variables
Repository context variables
External context variables
Complex context variables
Using embedded, repository, and external contexts
Summary
10. Worked Examples
Product catalog
Data import from the ERP system
Data import from Fabric Fashions
Data import from Runway Collections
Product inventory data
Order file processing
Order status updates
Automating processes
E-mailing daily sales
Automating product visibility
Summary
A. Installing Sample Jobs and Data
Downloading job and data files
Sample data files
Sample database
Sample jobs
B. Resources
Talend documentation
TalendForge forum
Webinars
Tutorials
Talend Exchange
Index O autorze: Jonathan Bowen is an E-commerce and Retail Systems Consultant and has worked in and around the retail industry for the past 20 years. His early career was in retail operations, then in the late 1990s he switched to the back office and has been integrating and implementing retail systems ever since. Since 2006, he has worked for one of the UKs largest e-commerce platform vendors as Head of Projects and, later, Head of Product Strategy. In that time he has worked on over 30 major e-commerce implementations. Outside of work, Jonathan, like many parents, has a busy schedule of sporting events, music lessons, and parties to take his kids to, and any downtime is often spent catching up with the latest tech news or trying to record electronic music in his home studio. You can get in touch with Jonathan at his website: www.learnintegration.com. mniej