topic Re: Use hadoop in DI studio. in SAS Data Management

Use hadoop in DI studio.

lau77 — Wed, 31 Oct 2012 07:38:15 GMT

Can I write a text file directly in a table hadoop?

How can I register a text file hadoop in data integration?

When i use a transfer file in hadoop node I have to reister a local text file and a remote text file (in this case hadoop text file) but I don't able to register in hadoop, how can I do?

Thanks

Laura

Re: Use hadoop in DI studio.

LinusH — Fri, 02 Nov 2012 10:21:29 GMT

Lot's of questions. Seems you need a crash course in SAS/Hadoop integration.

Have no own experience in this matter. Have you gone trough relevant documentation on the matter?

Try to be more specific in your questions.. I.e what do you exactly mean by a Hadoop text file. Hadoop as I understand it has many layers of data and metadata.

What do you mean that you are not able to register in Hadoop? What are you doing? Error messages?

Re: Use hadoop in DI studio.

lau77 — Fri, 02 Nov 2012 10:40:22 GMT

HAllo, i start to work whit SAS/hadoop integration now.

I Don't find a lot documentation in this matter.

i Have to write a log local file in hadoop, i see trasfert file in hadoop in data integration and i suppose that i have to register the corresponding file in hadoop.

anyway if you have a documentation in this matter.... It will be very usefull form me.... Thanks

laura

Re: Use hadoop in DI studio.

LinusH — Fri, 02 Nov 2012 11:23:48 GMT

Searching on hadoop on support.sas.com gives 267 hits. Have read through these?

Procedures Guide
ACCESS to Hadoop
DI Studio UG
Intelligent Platform: Data Administration Guide

And a list of papers I think are quite informative:

http://support.sas.com/dsearch?Find=Search&ct=5240&qt=hadoop&col=suppprd&nh=25&qp=&qc=suppsas&ws=1&qm=1&st=1&lk=1&rf=0&oq=&rq=0

Re: Use hadoop in DI studio.

abl0108 — Thu, 11 Feb 2016 21:00:07 GMT

Laura -

Did you ever find a solution?

I'm running into the same issue. I would like to register an external file to Hadoop to use after the Transfer to Hadoop transformation.

Thanks,

Avery

Re: Use hadoop in DI studio.

LinusH — Thu, 11 Feb 2016 21:53:10 GMT

This thread is three years old. It would probably be better if start a new one. When doing that, please provide a bit flesh to the bone. Like DIS version, Hadoop distribution / version and more details on your DIS process.