You will be primarily governing equipment that is coded as War Reserve Material (WRM) and earmarked to support the Deployable Air Base System (DABS). The products to manage these commodities are spread between various online systems. Exported reports are in various formats such as Comma Separated Value, Tabular Text, or Structured Text.
1) How would you go about analyzing big data (example: 65K rows and 34 columns) from these exported documents and what are some strategies you would use to brevity the information, but also be available for future manipulation?