Hi all,
I am trying to import a file using proc import step. But the file is not importing fully as there is a special character in a name (SZCZDE). After this name rest of the file is not imported and I get a error message. The file size is big so if I try to open the csv file and change the name it will not work because of the file size. Can you suggest what can I do to import the file?
Proc import
datafile='\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv'
out=Sep_release
dbms=csv
replace;
guessingrows=max ;
run;
1 ;*';*";*/;quit;run;
2 OPTIONS PAGENO=MIN;
3 %LET _CLIENTTASKLABEL='Importing the file';
4 %LET _CLIENTPROCESSFLOWNAME='Process Flow';
5 %LET _CLIENTPROJECTPATH='S:\Trace\Trace Integrity Analyst Data\Projects and Tasks\3. Sandeep\Equifax release\Equifax
5 ! released.egp';
6 %LET _CLIENTPROJECTPATHHOST='LWLT5CG9322XFL';
7 %LET _CLIENTPROJECTNAME='Equifax released.egp';
8 %LET _SASPROGRAMFILE='';
9 %LET _SASPROGRAMFILEHOST='';
10
11 ODS _ALL_ CLOSE;
12 OPTIONS DEV=SVG;
13 GOPTIONS XPIXELS=0 YPIXELS=0;
14 %macro HTML5AccessibleGraphSupported;
15 %if %_SAS_VERCOMP_FV(9,4,4, 0,0,0) >= 0 %then ACCESSIBLE_GRAPH;
16 %mend;
17 ODS LISTING GPATH=&sasworklocation;
18 FILENAME EGHTML TEMP;
19 ODS HTML5(ID=EGHTML) FILE=EGHTML
20 OPTIONS(BITMAP_MODE='INLINE')
21 %HTML5AccessibleGraphSupported
22 ENCODING='utf-8'
23 STYLE=HTMLBlue
24 NOGTITLE
25 NOGFOOTNOTE
26 GPATH=&sasworklocation
27 ;
NOTE: Writing HTML5(EGHTML) Body file: EGHTML
28
29 Proc import
30 datafile='\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly
30 ! Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv'
31 out=Sep_release
32 dbms=csv
33 replace;
34 guessingrows=max ;
35 run;
36 /**********************************************************************
37 * PRODUCT: SAS
38 * VERSION: 9.4
39 * CREATOR: External File Interface
40 * DATE: 11APR23
41 * DESC: Generated SAS Datastep Code
42 * TEMPLATE SOURCE: (None Specified.)
43 ***********************************************************************/
44 data WORK.SEP_RELEASE ;
45 %let _EFIERR_ = 0; /* set the ERROR detection macro variable */
46 infile '\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst Data\BAU_Processes\SAS\Enhanced
46 ! TPT\Storage\Monthly Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv' delimiter = ',' MISSOVER DSD
47 lrecl=32767 firstobs=2 ;
48 informat SEQUENCE_NUMBER best32. ;
49 informat REFERENCE_NUMBER best32. ;
50 informat ADDRESS_MATCHED $3. ;
51 informat ERROR_MESSAGE $75. ;
2 The SAS System 10:29 Tuesday, April 11, 2023
52 informat SEGMENT_NUMBER $4. ;
53 informat SEGMENT $25. ;
54 informat OPS_FLAG $20. ;
55 informat TA_ADDRESS1 $64. ;
56 informat TA_ADDRESS2 $32. ;
57 informat TA_ADDRESS3 $47. ;
58 informat TA_ADDRESS4 $18. ;
59 informat TA_PCODE $7. ;
60 informat RANK_1 best32. ;
61 informat RANK_TYPE_1 $21. ;
62 informat APPENDED_DOB best32. ;
63 informat APPENDED_FORENAME $15. ;
64 informat NO_INDIVIDUALS_SHARING_NM_DOB best32. ;
65 informat NO_INDIVIDUALS_SHARING_NM_NO_DOB best32. ;
66 informat DECEASED $3. ;
67 informat LAS_RES_IND $6. ;
68 informat LAS_NON_RES_IND $6. ;
69 informat LAS_NO_OPEN_INSIGHT_ACC best32. ;
70 informat LAS_NO_OPEN_INSIGHT_ACC_L3M best32. ;
71 informat LAS_NO_OPEN_INSIGHT_ACC_LM best32. ;
72 informat LAS_NO_DIFF_OPEN_INSIGHT_LENDERS best32. ;
73 informat LAS_CURRENTLY_REGISTERED_ON_ER $3. ;
74 informat LAS_TIME_SINCE_SUBJECT_ON_EER best32. ;
75 informat LAS_NEW_RR_IN_DIFF_SURNAME $15. ;
76 informat LAS_TIME_SINCE_RR_DELETE_FOR_APP $17. ;
77 informat LAS_REGISTERED_TELEPHONE_NUMBER $3. ;
78 informat LAS_TEL_NUMBER $13. ;
79 informat LAS_COUNT_ACTIVITY_IN_L1M $16. ;
80 informat LAS_COUNT_ACTIVITY_IN_L3M $16. ;
81 informat MOVEMENT_OUT_INDICATOR $19. ;
82 informat LAS_RES_COUNT_INCL_MOV_INFO best32. ;
83 informat LAS_NON_RES_COUNT_INCL_MOV_INFO best32. ;
84 informat TA_RESIDENCY_IND $6. ;
85 informat TA_NON_RESIDENCY_IND $6. ;
86 informat TA_NO_OPEN_INSIGHT_ACC best32. ;
87 informat TA_NO_OPEN_INSIGHT_ACC_L3M best32. ;
88 informat TA_NO_OPEN_INSIGHT_ACC_L1M best32. ;
89 informat TA_NO_DIFF_OPEN_INSIGHT_LENDERS best32. ;
90 informat TA_CURR_REG_ON_ER $3. ;
91 informat TA_TIME_SINCE_SUBJECT_ON_EER best32. ;
92 informat TA_NEW_RR_IN_DIFF_SURNAME $15. ;
93 informat TA_TIME_SINCE_RR_DELETE_FOR_APP $17. ;
94 informat TA_REG_TEL_NUM $3. ;
95 informat TA_TEL_NUM_1 $13. ;
96 informat TA_COUNT_ACTIVITY_IN_L1M $16. ;
97 informat TA_COUNT_ACTIVITY_IN_L3M $16. ;
98 informat TA_RES_COUNT_INCL_MOV_INFO best32. ;
99 informat TA_NON_RES_COUNT_INCL_MOV_INFO best32. ;
100 informat TYPE_1 $20. ;
101 informat LINK_DATE_1 best32. ;
102 informat EQUIFAX_ADDRESS_KEY_1 $11. ;
103 informat STD_CODE_1 $1. ;
104 informat LOCAL_NUMBER_1 $1. ;
105 informat TPS_1 $1. ;
106 informat DATE_LOADED_1 $1. ;
107 informat LINE_TYPE_1 $1. ;
108 informat DISTANCE_1 best32. ;
109 informat NAME_MATCH_1 $19. ;
3 The SAS System 10:29 Tuesday, April 11, 2023
110 informat NAME_1 $45. ;
111 informat DOB_1 best32. ;
112 informat ADDITIONAL_NAME1_1 $34. ;
113 informat ADDITIONAL_NAME2_1 $31. ;
114 informat ADDITIONAL_NAME3_1 $29. ;
115 informat DISPUTE_ALERT $2. ;
116 informat CIFAS $2. ;
117 informat CSISF30 best32. ;
118 informat OPS_NUM_S best32. ;
119 informat OPS_NUM_T best32. ;
120 format SEQUENCE_NUMBER best12. ;
121 format REFERENCE_NUMBER best12. ;
122 format ADDRESS_MATCHED $3. ;
123 format ERROR_MESSAGE $75. ;
124 format SEGMENT_NUMBER $4. ;
125 format SEGMENT $25. ;
126 format OPS_FLAG $20. ;
127 format TA_ADDRESS1 $64. ;
128 format TA_ADDRESS2 $32. ;
129 format TA_ADDRESS3 $47. ;
130 format TA_ADDRESS4 $18. ;
131 format TA_PCODE $7. ;
132 format RANK_1 best12. ;
133 format RANK_TYPE_1 $21. ;
134 format APPENDED_DOB best12. ;
135 format APPENDED_FORENAME $15. ;
136 format NO_INDIVIDUALS_SHARING_NM_DOB best12. ;
137 format NO_INDIVIDUALS_SHARING_NM_NO_DOB best12. ;
138 format DECEASED $3. ;
139 format LAS_RES_IND $6. ;
140 format LAS_NON_RES_IND $6. ;
141 format LAS_NO_OPEN_INSIGHT_ACC best12. ;
142 format LAS_NO_OPEN_INSIGHT_ACC_L3M best12. ;
143 format LAS_NO_OPEN_INSIGHT_ACC_LM best12. ;
144 format LAS_NO_DIFF_OPEN_INSIGHT_LENDERS best12. ;
145 format LAS_CURRENTLY_REGISTERED_ON_ER $3. ;
146 format LAS_TIME_SINCE_SUBJECT_ON_EER best12. ;
147 format LAS_NEW_RR_IN_DIFF_SURNAME $15. ;
148 format LAS_TIME_SINCE_RR_DELETE_FOR_APP $17. ;
149 format LAS_REGISTERED_TELEPHONE_NUMBER $3. ;
150 format LAS_TEL_NUMBER $13. ;
151 format LAS_COUNT_ACTIVITY_IN_L1M $16. ;
152 format LAS_COUNT_ACTIVITY_IN_L3M $16. ;
153 format MOVEMENT_OUT_INDICATOR $19. ;
154 format LAS_RES_COUNT_INCL_MOV_INFO best12. ;
155 format LAS_NON_RES_COUNT_INCL_MOV_INFO best12. ;
156 format TA_RESIDENCY_IND $6. ;
157 format TA_NON_RESIDENCY_IND $6. ;
158 format TA_NO_OPEN_INSIGHT_ACC best12. ;
159 format TA_NO_OPEN_INSIGHT_ACC_L3M best12. ;
160 format TA_NO_OPEN_INSIGHT_ACC_L1M best12. ;
161 format TA_NO_DIFF_OPEN_INSIGHT_LENDERS best12. ;
162 format TA_CURR_REG_ON_ER $3. ;
163 format TA_TIME_SINCE_SUBJECT_ON_EER best12. ;
164 format TA_NEW_RR_IN_DIFF_SURNAME $15. ;
165 format TA_TIME_SINCE_RR_DELETE_FOR_APP $17. ;
166 format TA_REG_TEL_NUM $3. ;
167 format TA_TEL_NUM_1 $13. ;
4 The SAS System 10:29 Tuesday, April 11, 2023
168 format TA_COUNT_ACTIVITY_IN_L1M $16. ;
169 format TA_COUNT_ACTIVITY_IN_L3M $16. ;
170 format TA_RES_COUNT_INCL_MOV_INFO best12. ;
171 format TA_NON_RES_COUNT_INCL_MOV_INFO best12. ;
172 format TYPE_1 $20. ;
173 format LINK_DATE_1 best12. ;
174 format EQUIFAX_ADDRESS_KEY_1 $11. ;
175 format STD_CODE_1 $1. ;
176 format LOCAL_NUMBER_1 $1. ;
177 format TPS_1 $1. ;
178 format DATE_LOADED_1 $1. ;
179 format LINE_TYPE_1 $1. ;
180 format DISTANCE_1 best12. ;
181 format NAME_MATCH_1 $19. ;
182 format NAME_1 $45. ;
183 format DOB_1 best12. ;
184 format ADDITIONAL_NAME1_1 $34. ;
185 format ADDITIONAL_NAME2_1 $31. ;
186 format ADDITIONAL_NAME3_1 $29. ;
187 format DISPUTE_ALERT $2. ;
188 format CIFAS $2. ;
189 format CSISF30 best12. ;
190 format OPS_NUM_S best12. ;
191 format OPS_NUM_T best12. ;
192 input
193 SEQUENCE_NUMBER
194 REFERENCE_NUMBER
195 ADDRESS_MATCHED $
196 ERROR_MESSAGE $
197 SEGMENT_NUMBER $
198 SEGMENT $
199 OPS_FLAG $
200 TA_ADDRESS1 $
201 TA_ADDRESS2 $
202 TA_ADDRESS3 $
203 TA_ADDRESS4 $
204 TA_PCODE $
205 RANK_1
206 RANK_TYPE_1 $
207 APPENDED_DOB
208 APPENDED_FORENAME $
209 NO_INDIVIDUALS_SHARING_NM_DOB
210 NO_INDIVIDUALS_SHARING_NM_NO_DOB
211 DECEASED $
212 LAS_RES_IND $
213 LAS_NON_RES_IND $
214 LAS_NO_OPEN_INSIGHT_ACC
215 LAS_NO_OPEN_INSIGHT_ACC_L3M
216 LAS_NO_OPEN_INSIGHT_ACC_LM
217 LAS_NO_DIFF_OPEN_INSIGHT_LENDERS
218 LAS_CURRENTLY_REGISTERED_ON_ER $
219 LAS_TIME_SINCE_SUBJECT_ON_EER
220 LAS_NEW_RR_IN_DIFF_SURNAME $
221 LAS_TIME_SINCE_RR_DELETE_FOR_APP $
222 LAS_REGISTERED_TELEPHONE_NUMBER $
223 LAS_TEL_NUMBER $
224 LAS_COUNT_ACTIVITY_IN_L1M $
225 LAS_COUNT_ACTIVITY_IN_L3M $
5 The SAS System 10:29 Tuesday, April 11, 2023
226 MOVEMENT_OUT_INDICATOR $
227 LAS_RES_COUNT_INCL_MOV_INFO
228 LAS_NON_RES_COUNT_INCL_MOV_INFO
229 TA_RESIDENCY_IND $
230 TA_NON_RESIDENCY_IND $
231 TA_NO_OPEN_INSIGHT_ACC
232 TA_NO_OPEN_INSIGHT_ACC_L3M
233 TA_NO_OPEN_INSIGHT_ACC_L1M
234 TA_NO_DIFF_OPEN_INSIGHT_LENDERS
235 TA_CURR_REG_ON_ER $
236 TA_TIME_SINCE_SUBJECT_ON_EER
237 TA_NEW_RR_IN_DIFF_SURNAME $
238 TA_TIME_SINCE_RR_DELETE_FOR_APP $
239 TA_REG_TEL_NUM $
240 TA_TEL_NUM_1 $
241 TA_COUNT_ACTIVITY_IN_L1M $
242 TA_COUNT_ACTIVITY_IN_L3M $
243 TA_RES_COUNT_INCL_MOV_INFO
244 TA_NON_RES_COUNT_INCL_MOV_INFO
245 TYPE_1 $
246 LINK_DATE_1
247 EQUIFAX_ADDRESS_KEY_1 $
248 STD_CODE_1 $
249 LOCAL_NUMBER_1 $
250 TPS_1 $
251 DATE_LOADED_1 $
252 LINE_TYPE_1 $
253 DISTANCE_1
254 NAME_MATCH_1 $
255 NAME_1 $
256 DOB_1
257 ADDITIONAL_NAME1_1 $
258 ADDITIONAL_NAME2_1 $
259 ADDITIONAL_NAME3_1 $
260 DISPUTE_ALERT $
261 CIFAS $
262 CSISF30
263 OPS_NUM_S
264 OPS_NUM_T
265 ;
266 if _ERROR_ then call symputx('_EFIERR_',1); /* set ERROR detection macro variable */
267 run;
NOTE: The infile '\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly
Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv' is:
Filename=\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly
Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv,
RECFM=V,LRECL=32767,
File Size (bytes)=296479614,
Last Modified=27Sep2022:11:37:43,
Create Time=27Sep2022:10:49:29
NOTE: Invalid data for DOB_1 in line 490359 372-382.
RULE: ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
490359 490359,328601349,Yes,,A1,App Trace No data,2 Ver,40 HOLLOW WAY,,COWLEY OXFORD,OXON,OX4 2NQ,100,Movem
101 ent,2061995,PRZEMYSLAW,1,0,NO,No,Strong,0,0,0,0,No,0,39,No delete records,No,,No searches ever,No se
201 arches ever,Subject,0,4,No,Some,0,0,0,0,No,0,15,No delete records,No,,No searches ever,No searches e
6 The SAS System 10:29 Tuesday, April 11, 2023
RULE: ----+----1----+----2----+----3----+----4----+----5----+----6----+----7----+----8----+----9----+----0
301 ver,0,1,Last link in a chain,12112019,52080041086,,,,,,183,Subject,"MR,PRZEMYSE.AW, ,SZCZD.E 392
ZONE 76723232467726666266262666662333333332333333333332222223332576666722452555445540452225545414
NUMR 652C0C1CC1340C9EB09E0103819EC12112019C52080041086CCCCCC183C352A534C2D2C02A5D935117C0C3A3A485
SEQUENCE_NUMBER=490359 REFERENCE_NUMBER=328601349 ADDRESS_MATCHED=Yes ERROR_MESSAGE= SEGMENT_NUMBER=A1 SEGMENT=App Trace No data
OPS_FLAG=2 Ver TA_ADDRESS1=40 HOLLOW WAY TA_ADDRESS2= TA_ADDRESS3=COWLEY OXFORD TA_ADDRESS4=OXON TA_PCODE=OX4 2NQ RANK_1=100
RANK_TYPE_1=Movement APPENDED_DOB=2061995 APPENDED_FORENAME=PRZEMYSLAW NO_INDIVIDUALS_SHARING_NM_DOB=1
NO_INDIVIDUALS_SHARING_NM_NO_DOB=0 DECEASED=NO LAS_RES_IND=No LAS_NON_RES_IND=Strong LAS_NO_OPEN_INSIGHT_ACC=0
LAS_NO_OPEN_INSIGHT_ACC_L3M=0 LAS_NO_OPEN_INSIGHT_ACC_LM=0 LAS_NO_DIFF_OPEN_INSIGHT_LENDERS=0 LAS_CURRENTLY_REGISTERED_ON_ER=No
LAS_TIME_SINCE_SUBJECT_ON_EER=0 LAS_NEW_RR_IN_DIFF_SURNAME=39 LAS_TIME_SINCE_RR_DELETE_FOR_APP=No delete records
LAS_REGISTERED_TELEPHONE_NUMBER=No LAS_TEL_NUMBER= LAS_COUNT_ACTIVITY_IN_L1M=No searches ever
LAS_COUNT_ACTIVITY_IN_L3M=No searches ever MOVEMENT_OUT_INDICATOR=Subject LAS_RES_COUNT_INCL_MOV_INFO=0
LAS_NON_RES_COUNT_INCL_MOV_INFO=4 TA_RESIDENCY_IND=No TA_NON_RESIDENCY_IND=Some TA_NO_OPEN_INSIGHT_ACC=0
TA_NO_OPEN_INSIGHT_ACC_L3M=0 TA_NO_OPEN_INSIGHT_ACC_L1M=0 TA_NO_DIFF_OPEN_INSIGHT_LENDERS=0 TA_CURR_REG_ON_ER=No
TA_TIME_SINCE_SUBJECT_ON_EER=0 TA_NEW_RR_IN_DIFF_SURNAME=15 TA_TIME_SINCE_RR_DELETE_FOR_APP=No delete records TA_REG_TEL_NUM=No
TA_TEL_NUM_1= TA_COUNT_ACTIVITY_IN_L1M=No searches ever TA_COUNT_ACTIVITY_IN_L3M=No searches ever TA_RES_COUNT_INCL_MOV_INFO=0
TA_NON_RES_COUNT_INCL_MOV_INFO=1 TYPE_1=Last link in a chain LINK_DATE_1=12112019 EQUIFAX_ADDRESS_KEY_1=52080041086 STD_CODE_1=
LOCAL_NUMBER_1= TPS_1= DATE_LOADED_1= LINE_TYPE_1= DISTANCE_1=183 NAME_MATCH_1=Subject NAME_1="MR DOB_1=. ADDITIONAL_NAME1_1=
ADDITIONAL_NAME2_1=SZCZDE ADDITIONAL_NAME3_1= DISPUTE_ALERT= CIFAS= CSISF30=. OPS_NUM_S=. OPS_NUM_T=. _ERROR_=1 _N_=490358
NOTE: 490358 records were read from the infile '\\lowell2.local\shares\Public\Trace\Trace Integrity Analyst
Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv'.
The minimum record length was 114.
The maximum record length was 546.
NOTE: The data set WORK.SEP_RELEASE has 490358 observations and 72 variables.
NOTE: Compressing data set WORK.SEP_RELEASE decreased size by 67.85 percent.
Compressed is 2319 pages; un-compressed would require 7212 pages.
NOTE: DATA statement used (Total process time):
real time 3.07 seconds
user cpu time 2.84 seconds
system cpu time 0.12 seconds
memory 10524.53k
OS Memory 39436.00k
Timestamp 04/12/2023 01:15:36 PM
Step Count 56 Switch Count 2
Errors detected in submitted DATA step. Examine log.
490358 rows created in WORK.SEP_RELEASE from \\lowell2.local\shares\Public\Trace\Trace Integrity Analyst
Data\BAU_Processes\SAS\Enhanced TPT\Storage\Monthly
Washes\2022_09_12\elnz_Lowell_12Sep_NEW.csv.
ERROR: Import unsuccessful. See SAS Log for details.
NOTE: The SAS System stopped processing this step because of errors.
NOTE: PROCEDURE IMPORT used (Total process time):
real time 10:30.79
user cpu time 8:42.78
system cpu time 4.12 seconds
memory 10524.53k
OS Memory 39692.00k
Timestamp 04/12/2023 01:15:36 PM
Step Count 56 Switch Count 11
268
269 %LET _CLIENTTASKLABEL=;
270 %LET _CLIENTPROCESSFLOWNAME=;
7 The SAS System 10:29 Tuesday, April 11, 2023
271 %LET _CLIENTPROJECTPATH=;
272 %LET _CLIENTPROJECTPATHHOST=;
273 %LET _CLIENTPROJECTNAME=;
274 %LET _SASPROGRAMFILE=;
275 %LET _SASPROGRAMFILEHOST=;
276
277 ;*';*";*/;quit;run;
278 ODS _ALL_ CLOSE;
279
280
281 QUIT; RUN;
282
