|
CoSort and Flat Files Can Speed Data Movement
Challenges:
A common lifecycle event for databases is the migration to a new version (e.g. Oracle 9i to 11G)
or a different system altogether (e.g. DB2 to SQL Server).
Many migrations require more than export/import because they also involve changes to the hardware
platform and operating system, schema, or dependent applications.
In addition to these qualitative requirements, there may be a quantitative issue:
the sheer volume of data to be migrated can create a performance problem during unload, transform,
or reload jobs.
Solutions:
Use the power and convenience of flat files to migrate from one source to
another. Starting with offload tools like IRI's Fast Extract (FACT)
for Oracle, or recommended techniques (like unencumbered unloads), you can
improve database unload performance.
Once your source table data are available in external files, IRI's CoSort
product gives you the ability to leverage the power of the file system,
allowing you to perform and/or combine data:
| Transformation |
sort, join, aggregate, report, etc. |
| Conversion |
of both data and file types |
| Protection |
field-level encryption, masking |
| Presentation |
detail, summary and delta reports |
CoSort uses a powerful 4GL program called SortCL
to map fields to one or more load, BI, and other hand-off targets. Schema
changes, new views, different query orders, and privacy protections are
now possible in parallel, single-pass operations that do all of the above.
Create new tables as needed, and load files faster pre-sorted on the longest
index column (primary key).
See also:
Optimize Unload, Load and Reorg Performance
Solutions > Data Transformation
Solutions > Data Transformation > Data Type Conversion
Solutions > File Interchange (File Format Conversion)
Solutions > Test Data/Files > DB Population
Products > Fast Extract (FACT)
Products > CoSort > SortCL
Products > RowGen (Test Data) |
1-800-333-SORT
1-321-777-8889
|