I am attempting to work with a very large data-set (~1.5mil lines) for the first time in SAS and I am having some difficulty. The data-set I have is formatted as a "long" .txt file as follows:
'cat1/: Topic1_Variable1' 'cat2/: Topic1_Variable2' 'cat3/: Topic1_Variable3' 'cat4/: Topic1_Variable4' 'cat1/: Topic2_Variable1' 'cat2/: Topic2_Variable2' 'cat3/: Topic2_Variable3' 'cat4/: Topic2_Variable4' 'cat1/: Topic3_Variable1' 'cat2/: Topic3_Variable2' 'cat3/: Topic3_Variable3' 'cat4/: Topic3_Variable4' ...
Fro analysis and sharing with others, I really would like to see it formatted as follows:
cat1 cat2 cat3 cat4 Topic1_Variable1 Topic1_Variable2 Topic1_Variable3 Topic1_Variable4 Topic2_Variable1 Topic2_Variable2 Topic2_Variable3 Topic2_Variable4 Topic3_Variable1 Topic3_Variable2 Topic3_Variable3 Topic3_Variable4
I think that this may be easier in R, but I honestly am drawing a complete blank in SAS. I've even played with MS Access to try to get it to look the way I want but the program crashes every time (due to the size?). At any rate, I have looked into some of the statements in PROC TRANSPOSE and PROC SQL but it seems that most functions within those procedures are utilized to combine duplicate 'Topics'. In the data I have been provided, each "group" represents an individual response to a question with several thousand individuals repeated, I want to retain the independence of each occurrence and not perform a UNION as defined in PROC SQL. At this point, I feel like I am over-thinking this but I just can't get around the mental block and actually do what I am working toward. Any help or guidance is much appreciated. I'm open to trying all suggestions or ideas, I think I have access to most statistical computing programs.