wget, reverse web cache testing

This is a highly specialized note, but it might be helpful as a test idea for more general use cases.

I have a bluecoat web proxy serving as a reverse proxy for some images on our web site.  A citrix netscaler sits in front of the bluecoats and distributes the load the bluecoats.  We use Qradar as our SEIM and this is how I test one of the bluecoats using "live" data:

1. Start by getting a cvs text file of successful queries from Qradar (i.e. run a search, export the raw events as CSV.
2. transform log into generic URLS: sed -e 's/^.*PROXIED//' 2010-05-26-data_export.csv| awk '{ print $7"://"$8":"$9$10 } ' | grep "^http" > /tmp/1 :
3. use the computed URLS and run against the bluecoat:

   for LINE in `cat /tmp/1`; do http_proxy=http://BLUECOAT001:80 wget "$LINE"; done:

4. Run against comparative bluecoat:
   

   for LINE in `cat /tmp/1`; do http_proxy=http://BLUECOAT002:80 wget "$LINE"; done: 

5. Compare the results