Use PowerShell » One Liner http://blog.usepowershell.com Real Admins Script Tue, 07 Sep 2010 22:52:26 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 Finding the K Most Common Words in a File http://blog.usepowershell.com/2009/02/finding-the-k-most-common-words-in-a-file/ http://blog.usepowershell.com/2009/02/finding-the-k-most-common-words-in-a-file/#comments Sat, 07 Feb 2009 19:38:09 +0000 Steven Murawski http://blog.usepowershell.com/2009/02/finding-the-k-most-common-words-in-a-file/ Doug Finke recently posted a blog post about finding the most common words in a file.

Doug put together a little 19 line PowerShell script to solve the issue, but something just called to me about how it wasn’t necessarily playing to some of the included cmdlets in PowerShell.

So, here’s my interpretation as a one liner:

get-content big.txt | foreach-object {[regex]::split($_.ToLower(), ‘\W+’)} | where-object {$_.length -gt 0} | group-object | sort-object -property count -descending | select-object -property name -first 6

EDIT: One thing I’ve noticed is Doug’s script runs much faster..

]]> http://blog.usepowershell.com/2009/02/finding-the-k-most-common-words-in-a-file/feed/ 0