About Havi

Havi · ‎02-12-2013

Hi All Please advise. I extract huge datasets and convert them to CSV format. I have these files saved on a UNIX server. What is the best way to send these files to a Big data VM appliance. Is it possible to send them from my remote session in unix while converting them to CSV? What are some of my alternatives? Thanks a million

Havi · ‎02-07-2013

Thanks for your help. Is this way the best way to select the last record for a dataset were num1 and num2 are the same?? Also cost will have to be 0. My data set has 80612210 obs. I dont want this process to take too long as I have quite a few data steps after this one.

Havi · ‎02-07-2013

Thanks for the response LinusH. Ok Ignore the question above. Let me rephrase. Ideally I want to retain the last records class and ID where num1 and num2 are the same. My condition will be if num1 and num2 are the same and cost = 0 than take the last record. eg: INPUT: SEQ Num1 Num2 Class Cost Time ID 1 12 13 . 0 50 A123 2 12 13 A 0 60 A123 3 12 18 A 60 10 A123 OUTPUT: SEQ Num1 Num2 Class Cost Time ID 2 12 13 A 0 60 A123 3 12 18 A 60 10 A123 Please advise. Thank you.

Havi · ‎02-07-2013

Hi All Please please help. I have this really large dataset that I need to clean up so I need this process to be optimized the best way possible. Please see below for sample records: INPUT: SEQ Num1 Num2 Class Cost Time ID 1 12 13 . 0 50 A123 2 12 13 A 0 40 A123 3 12 18 A 60 10 A123 OUTPUT: SEQ Num1 Num2 Class Cost Time ID 2 12 13 A 0 90 A123 3 12 18 A 60 10 A123 I need to search through all the data to see where num1 and num2 match and where cost = 0 and summarize the time accordingly in 1 record along with the class as per the above. I require the desired output. Thanks for the help.

Havi · ‎07-27-2012

Thanks Amir 🙂

Havi · ‎07-27-2012

Hi Amir The 1st in statement will select all codes that have PPP in them including PPPBB which I do not want.

Havi · ‎07-27-2012

Hi All I want to calculate amounts for a large number of codes eg: if code in ('BBB','PPP') then amount = 1; but I want it to exclude the codes PPPBB and PPPCC as that code will be calculated separately eg: if code in ('PPPBB','PPPCC') then amount = 2; Sorry can't get my head around this. Thank you

Havi · ‎07-25-2012

Thanks for your response Linlin. Yes but I need to see how it differs from the previous datasets - what new variable has been added.

Havi · ‎07-25-2012

Hi All Please help me. I need a program to check the variables in a dataset and if possible list the variable type. Example: I have 3 datasets. I need to check the variables in each dataset at the end of the month in order to track changes to the dataset structure and raise a flag if the table structure changes. Test201207 has 2 variables: amount, date Test201208 has 3 variables: amount, date and customer_id Test201209 has 4 variables: amount, date, customer_id and count Thanks

Havi · ‎06-28-2012

Thanks Patrick, makes sense. The format however will not work as I have duplicate names with different types.

Havi · ‎06-27-2012

Hi Patrick Thank you for your response, please see below: /* template.sas*/ ID: Name: Type: 101 Data Bytes 102 Account Rand 103 DataValue Bytes 104 Datavalue Bytes I currently use the program below and manually add in entries so the problem is that I am not aware of new entries that are added in template.sas and often overlook it. I want to create 2 variables data_unit and rand_unit as shown below: ********************************************************************************************************* PROC FORMAT LIBRARY=WORK; VALUE $Unit 'DATA' = '*B' 'ACCOUNT'= '*R' 'DATAVALUE'='*B'; RUN; %GLOBAL Rand_Unit Data_Unit; DATA Unit; LENGTH Unit_Type $12 Unit_Name $10; INPUT Unit_Type 1-12 Unit_Name 13-23 ; Datalines; Data_Unit DATA Data_Unit DATAVALUE Rand_Unit ACCOUNT ;;; run; PROC SQL Noprint; SELECT QUOTE(TRIM(Unit_Name))INTO :Data_Unit separated BY ',' FROM Unit WHERE Unit_Type='Data_Unit';; SELECT QUOTE(TRIM(Unit_Name))INTO :Rand_Unit separated BY ',' FROM Unit WHERE Unit_Type='Rand_Unit';; QUIT; %PUT &Data_Unit; %PUT &Rand_Unit; I thereafter include this program in a program that needs the variables &Rand_unit and &data_unit %include "/home/xxx/global_variables.sas"; This is an example of how I use it: IF UPCASE(TRIM(unit)) in (&Rand_unit) THEN Prod='000'; ELSE IF UPCASE(TRIM(unit)) in (&Data_unit) THEN Prod='123';

Havi · ‎06-26-2012

Thank you for your response Shivas. I actually need to read values from the table in order to create global variables. Using cards/datalines will mean I have to enter data from the table and will not be aware immediately when a new entry is added. In order to do this I need to go through each entry in the table and check its type to determine in which group of global variables it belongs. eg: if type = bytes then it is data_unit if type = rand then it is rand_unit

Havi · ‎06-26-2012

I have a table that is updated daily with the following values. I need to reference these values as global variables in other sas programs. ID: Name: Type: 101 Data Bytes 102 Account Rand 103 DataValue Bytes I currently use the program below and manually add in entries so the problem is that I am not aware of new entries and often overlook it. Is there a more efficient way to do this?? I want to create 2 variables data_unit and rand_unit based on the name and type. ********************************************************************************************************* PROC FORMAT LIBRARY=WORK; VALUE $Unit 'DATA' = '*B' 'ACCOUNT'= '*R' 'DATAVALUE'='*B'; RUN; %GLOBAL Rand_Unit Data_Unit; DATA Unit; LENGTH Unit_Type $12 Unit_Name $10; INPUT Unit_Type 1-12 Unit_Name 13-23 ; Datalines; Data_Unit DATA Data_Unit DATAVALUE Rand_Unit ACCOUNT ;;; run; PROC SQL Noprint; SELECT QUOTE(TRIM(Unit_Name))INTO :Data_Unit separated BY ',' FROM Unit WHERE Unit_Type='Data_Unit';; SELECT QUOTE(TRIM(Unit_Name))INTO :Rand_Unit separated BY ',' FROM Unit WHERE Unit_Type='Rand_Unit';; QUIT; %PUT &Data_Unit; %PUT &Rand_Unit; ********************************************************************************************************* Please advise, thank you.

Havi · ‎06-25-2012

Thank you Shivas, worked great!!

Havi · ‎06-25-2012

Hi All Please help, I have two datasets: Name Acc Code Shop1 A0001 Stationery Shop2 A0002 Clothes Shop3 A0003 Groceries Date Acc Phone_Number 01MAY2012 A0001 00112000009 01MAY2012 A0001 00112000010 01MAY2012 A0001 00112000011 01MAY2012 A0002 00112000555 01MAY2012 A0002 00112000666 01MAY2012 A0003 00112005678 I want to merge the two datasets to achieve the below dataset: Date : Acc: Phone_Number: Name: Code: 01MAY2012 A0001 00112000009 Shop1 Stationery 01MAY2012 A0001 00112000010 Shop1 Stationery 01MAY2012 A0001 00112000011 Shop1 Stationery 01MAY2012 A0002 00112000555 Shop2 Clothes 01MAY2012 A0002 00112000666 Shop2 Clothes 01MAY2012 A0003 00112005678 Shop3 Groceries Thanks 🙂

Online Status	Offline
Date Last Visited	‎02-05-2019 07:47 AM

Re: Help with arrays

Help with arrays

Re: Help to join and re-label variables

Re: Help to join and re-label variables

Re: Help to join and re-label variables

Help to join and re-label variables

Re: How to find unique number in a range of min and max values

Re: How to find unique number in a range of min and max values

How to find unique number in a range of min and max values

Re: How to find min max for a range

Re: Help with arrays

Re: Help with arrays

Re: Help with arrays

Re: How to find unique number in a range of min and max values

Re: How to find min max for a range

How to sftp files

Re: Remove Duplicates and merge records efficiently

Re: Remove Duplicates and merge records efficiently

Remove Duplicates and merge records efficiently

Re: if else

Re: if else

if else

Re: Help listing variables and types

Help listing variables and types

Re: more efficient way to program

Re: more efficient way to program

Re: more efficient way to program

more efficient way to program

Re: Help with merge

Help with merge