Sort files by filename

Mark Haney mhaney at ercbroadband.org
Tue Jul 31 19:12:27 UTC 2007


Les Mikesell wrote:

>>>>
>>>
>>> Is there a reason why rsync cannot be used for this?
>>
>> Unfortunately, yes, due to the method that I receive the files, ie 
>> from another application that has it's own mechanism to feed the files 
>> to client machines.  I really wish this wasn't the case, but I have to 
>> live with what I got.
> 
> If you request the resends with http you could use wget with the option 
> to only transfer if the server's copy is newer than yours, and just ask 
> for all of them every time.
> 
> Or, if you can construct the (sorted)list of all the names you expect to 
> have you can:
> 
> ls * | comm -13 - /path/to/list
> 
> and get the list of names in the list but not in the directory.
> 


With apologies to the 2 Les', the situation isn't like that and I 
apologize if I've not been clear.  The application that I'm working with 
  is running on a server that simply relays the data to all our 
customers, it doesn't store a copy of the files and then feed them.  The 
NWS weather data requires as close to real-time performance and the 
'series of tubes' allows.  That said, I'm running another server that 
runs the same application but is designed to pull the data feed and then 
store the files locally.  I /can/ store the files on the primary server, 
and I have, but this is a production server that feeds 13MB/hr for each 
of the 60 or so radar sites it handles 24/7 so I don't like asking it to 
do more than it does.

So, in essence I'm stuck with these files being dumped on a server via a 
proprietary method.  So I need to sort the files and check for missing 
ones on the filesystem.

The early suggestions were great and I'm trying each one and tweaking to 
see if I can make them work with what I have.  But any additional bash 
tips would be helpful as I am pressed for an answer to this issue.


-- 
Recedite, plebes! Gero rem imperialem!


Mark Haney
Sr. Systems Administrator
ERC Broadband
(828) 350-2415

Call (866) ERC-7110 for after hours support




More information about the fedora-list mailing list