SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

SAS DI (importing files)

Reply
Occasional Contributor
Posts: 14

SAS DI (importing files)

Hi All,

di  di-studio  di_studio  dis  distudioI have a businees users in different countries, each country have their file format(ex: .csv, txt,mdb...).

But within a same country their might be multiple customers and they can send the multiple files.suppose in india we have 5 customers in 5 different states they can send 5 files from 5 states, all file formats of india are same

I need to create a process to load files of each country in target table using SAS DI,the number of files per country may vary at any time.

Any help on this would be helpful and appreciated.

Regards,

Srini

Super User
Posts: 5,256

Re: SAS DI (importing files)

Do the different files formats have the same internal structure?  (no of fields, content,  data type etc).There are probably many ways to this; ranging from user written file, using parameters or building separate jobs for each file type. To chose is part of design process and should be done on site.

Data never sleeps
Respected Advisor
Posts: 3,890

Re: SAS DI (importing files)

Please don't post the same question multiple times. My answer here:

PROC Star
Posts: 1,093

Re: SAS DI (importing files)

I agree with @LinusH's comment.

My first thought is to set up a dedicated conversion for each country. This conversion i) inputs the data, ii) edits it, and iii) converts it to a SAS dataset format. Run this for each file, and then the last element appends all of the files together.

From there on, you can use this file with standard DIS processes.

I'm quite familiar with having different file formats from different stakeholders. Personally, I think if you try to find any shortcuts or efficiencies, you'll end up frustrated in the long term.

Tom

Ask a Question
Discussion stats
  • 3 replies
  • 297 views
  • 0 likes
  • 4 in conversation