Finding non ascii characters in a text file

stackoverflow link
http://stackoverflow.com/questions/3001177/how-do-i-grep-for-all-non-ascii-characters-in-unix


My favorite out of this:
grep -P "[\x80-\xFF]" file.xml


This was really useful when compiling AWS Cloudformation templates since you can't have certain characters in the JSON.

Comments

Post a Comment

Popular posts from this blog

syslog-ng on cygwin

I am developing some PERL scripts for OMNIbus/Netcool at work.  Because my company restricts freedom and discourages innovation, we are stuck on Microsoft.  Luckily they haven't locked us down to the point where we can not install new software.   So I've become a big fan of Cygwin.  I've never used heroin, but I suspect my use of Cygwin is much like an addict's use of Methadone.  It keeps me alive, just barely. Anyway, this piece of knowledge was not the most straightforward piece to find, or I'm just an idiot (not that those are mutually exclusive.)  However on the winblows box, syslong-ng runs under Cygwin and even sets itself up as a service which is cool. Side Note:  if you want to upgrade Cygwin and are getting file in use problems and are running syslog-ng, you probably need to shutdown the service during upgrades. Anyway, marking and statistics in /var/log/messages on winblows are pointless and just consume disk space.   Normal goo...
Read more

Failure at installing Fedora 20 on a mac mini

This was an attempt to put Fedora 20 on a 2008-ish mac mini. Even though this box has a 64-bit processor, it has 32-bit EFI.  Fedora installers come in 1 of 2 configurations: 64-bit EFI / x86_64 32-bit Bios /  i686 Rather than go through the rigmarole of wrapping my own 32bit EFI with x86_x64, I went with the easy approach of 32-bit Bios + i686.  The box only has 2GB of RAM, so I am not really missing out on anything. I've grown quite accustomed to XFCE so I downloaded the i686 spin: http://download.fedoraproject.org/pub/fedora/linux/releases/20/Live/i386/Fedora-Live-Xfce-i686-20-1.iso Download and installed base system Post installation configuration: systemctl enable sshd.service systemctl start sshd.service yum -y update yum -y install vim-enhanced yum -y install yum-plugin-keys yum-plugin-fastestmirror yum-plugin-remove-with-leaves yum-plugin-show-leaves yum-plugin-verify yum  -y install xfce4-cpufreq-plugin xfce4-icon-theme xfce4-volumed xfce-the...
Read more

Xubuntu on an HP z420

Image
This is my primary work computer. I recently decided to switch from Fedora to Xubuntu. I still like Fedora, but we are using more Ubuntu at work and I need to get myself more familiar with that way of doing things. I am copying a lot of the configuration that I did with my Sager NP9758 laptop configuration. After updating an rebooting, I enabled the Nvidia binary drivers and Intel binary blob. Next step let's get google chrome on here as well as firefox http://askubuntu.com/questions/510056/how-to-install-google-chrome wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | sudo apt-key add - sudo sh -c 'echo "deb https://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google.list' sudo apt-get update sudo apt-get install google-chrome-beta Apparently installing beta Google Chrome results in a second apt source being created. This causes an error when running `sudo apt-get update`. To fix `sudo v...
Read more