{"id":3576,"date":"2012-05-25T08:26:26","date_gmt":"2012-05-25T13:26:26","guid":{"rendered":"https:\/\/blogs.mathworks.com\/pick\/?p=3576"},"modified":"2012-05-25T12:03:59","modified_gmt":"2012-05-25T17:03:59","slug":"grep-text-searching-utility","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/pick\/2012\/05\/25\/grep-text-searching-utility\/","title":{"rendered":"grep – Text searching utility"},"content":{"rendered":"
\r\n

Jiro<\/a>'s pick this week is grep: a pedestrian, very fast grep utility<\/a> by Us<\/a>.\r\n <\/p>\r\n

This week's pick is a recommendation from Yair<\/a>, who himself is a prominent participant on MATLAB Central. Us has created a number of very useful functions over the years,\r\n and there's nothing pedestrian about his entries!\r\n <\/p>\r\n

This week, I was in Seattle presenting at University of Washington, and during the seminar I received a question about the\r\n best way to scan through a file for a certain text pattern that denotes the beginning of data. She was scanning the file line\r\n by line using textscan<\/tt><\/a> to find the text of interest, and she was wondering if there was a more efficient way. The method she described seemed pretty\r\n reasonable. textscan<\/tt> is very efficient in scanning text files, and it's a good function for dealing with extremely large files, if you want to\r\n read them in chunks. Then I remembered Us's grep<\/tt>. I remembered Yair had suggested<\/a> it, and that there were many positive responses to the entry. I suggested that she take a look at the function and to use\r\n it in conjunction with textscan<\/tt> to do the data reading afterwards.\r\n <\/p>\r\n

Here's a quick example of how it works. In a folder called \"data_files\", I have 10 files, each of which contains experimental\r\n data from 100 tests. Each test is separated by a line indicating the test number.\r\n <\/p>

   Test  1\r\n   1.776199\r\n   3.552398\r\n   5.328597\r\n     .\r\n     .\r\n     .\r\n   Test  2\r\n   7.250518\r\n   4.510056\r\n   5.797272\r\n     .\r\n     .\r\n     .\r\n   Test  3\r\n     .\r\n     .\r\n     .
<\/p><\/pre>
Because each file contains different number of data points, the file sizes are different.<\/p>
fInfo = dir('data_files\/*.txt'<\/span>);\r\ns = [{fInfo.name}; num2cell([fInfo.bytes]\/2^20)];\r\nfprintf('%s: %4.1f MB\\n'<\/span>, s{:})<\/pre>
ModelResults01.txt:  8.2 MB\r\nModelResults02.txt:  7.7 MB\r\nModelResults03.txt: 13.0 MB\r\nModelResults04.txt:  1.9 MB\r\nModelResults05.txt:  1.6 MB\r\nModelResults06.txt: 24.1 MB\r\nModelResults07.txt: 11.8 MB\r\nModelResults08.txt:  9.1 MB\r\nModelResults09.txt: 20.6 MB\r\nModelResults10.txt: 20.7 MB\r\n<\/pre>
Let's say that I want to extract data for Test 60. To identify the lines where Test 60 starts and ends, we can look for the\r\n      texts \"Test  60\" and \"Test  61\".\r\n   <\/p>
tic;\r\n[fl, p] = grep('-u -n'<\/span>, {'Test  60'<\/span>, 'Test  61'<\/span>}, 'data_files\/*.txt'<\/span>);\r\ndisp(' '<\/span>); toc;<\/pre>
ModelResults01.txt:175704: Test  60\r\nModelResults01.txt:178682: Test  61\r\nModelResults02.txt:164907: Test  60\r\nModelResults02.txt:167702: Test  61\r\nModelResults03.txt:278423: Test  60\r\nModelResults03.txt:283142: Test  61\r\nModelResults04.txt:40417: Test  60\r\nModelResults04.txt:41102: Test  61\r\nModelResults05.txt:33337: Test  60\r\nModelResults05.txt:33902: Test  61\r\nModelResults06.txt:514069: Test  60\r\nModelResults06.txt:522782: Test  61\r\nModelResults07.txt:251578: Test  60\r\nModelResults07.txt:255842: Test  61\r\nModelResults08.txt:194584: Test  60\r\nModelResults08.txt:197882: Test  61\r\nModelResults09.txt:440201: Test  60\r\nModelResults09.txt:447662: Test  61\r\nModelResults10.txt:440850: Test  60\r\nModelResults10.txt:448322: Test  61\r\n \r\nElapsed time is 1.997956 seconds.\r\n<\/pre>
As you can see from the comments on the File Exchange entry page, the function runs extremely efficiently. The outputs from\r\n      the function provide details about the search result, including line numbers. What I like most about Us's entry is the extensive\r\n      HTML help he has on the function. He explains all the various options grep<\/tt> takes and the results structure that it returns, and he includes several examples that get you started.\r\n   <\/p>\r\n   
Thanks Us for this great utility and Yair for the recommendation!<\/p>\r\n   
Comments<\/b><\/p>\r\n   
If you haven't used this, give it a spin and let us know what you think here<\/a> or leave a comment<\/a> for Us.\r\n   <\/p>\r\n   
Please keep nominating your favorite File Exchange entries here<\/a>.\r\n   <\/p>