ST Alpha - "Excel/Access Question: Okay, so I have giant .csv file, of about 4.1 million lines..." (Reading a Post)

SlickerTalk
Search Archives
The Leaderboard
The FAQ

Down to Post

Backboards:

Posts: 154

Excel/Access Question: Okay, so I have giant .csv file, of about 4.1 million lines...

Posted by Jovian (aka Jovian) Mar 9 '10, 13:23

I need to compare this to a list of about 40,000 items.

now normally, I would just open it up in Excel and use a vlookup compare and be done with it.

but the problem is this is 4.1 million lines. And Excel only supports barely under 1 million.

so I need to break this file up into to 5 seperate excel spreadsheets to run my compares.

any ideas how to break this file up? I am trying to use access but dont see how I can export only pieces of it.

any help would be appreciated!

thanks

Responses:

You could use SQL to import using bulk insert, then connect Excel 2007 to SQL very easily. -- (link) - scorpion Mar 9, 13:54
Make 5 copies of the file and delete a different 3.28 million lines from each one? -- nm - Ender Mar 9, 13:28 3
- I think this is what kilbo meant when he suggested notepad -- nm - Beryllium Mar 9, 13:29 2
  - I hope he has alot of RAM -- nm - oblique Mar 9, 13:30 1
    - RAM's dead -- nm - Clu Mar 9, 13:47
uhm, you could do the whole comparison in Access, if you set up two separate tables - Beryllium Mar 9, 13:26 4
- The mind boggles at why a 4.1 million line CSV exists in the first place :) -- nm - oblique Mar 9, 13:28 3
  - a clients file inventory. -- nm - Jovian Mar 9, 13:35
  - I can see log files getting that size if they are not logrotated. -- nm - decline Mar 9, 13:29
  - I've worked with some approaching that size ... -- nm - Beryllium Mar 9, 13:28
On Windows? you need a dos file splitter program. (linux has split - go figure). Google: 'dos split file command'. -- nm - decline Mar 9, 13:25 1
- this one actually looks promising: -- (link) - decline Mar 9, 13:26
notepad? -- nm - oblique Mar 9, 13:24
That's a hell of a cold calling list. -- nm - Max Mar 9, 13:24 2
- no longer than your list of dating criteria for chicks -- nm - 16 & pixie Mar 9, 13:25
- heh -- nm - Spawn Mar 9, 13:25

Post a message top

Excel/Access Question: Okay, so I have giant .csv file, of about 4.1 million lines...

Replies are disabled on threads older than 7 days.