Here are more details as to why. as i noted there had been a few days of ongoing hardware issues.. failing drives and RAID controllers.. in the beginning they were more "flakey" than actually failing. we worked through that and hoped for the best... well it turned out that they were quite toasted and when one drive finally failed we lost the whole data partition on the server. this was caused by the RAID controller writing bad parity blocks in the RAID volume.
OK. I will take this opportunity to thank Rob for his efforts but also geek out with a few comments and questions. Sys Admin and Integration is part of my job, so I have had the opportunity to work with storage and networking equipment on a daily basis - and understand the limitations, frustrations and liabilities. The only difference is that our setup is primarily Mac OS X based, and I am guessing that Rob runs (or is hosted by) PC or Linux servers.
Geeky Q #1: Our Xserve RAID volumes (RAID 5) have a utility for rebuilding the RAID parity data should it get corrupted, and reconditioning bad blocks while the system, all while the system is live. Did you have that option? I am not sure what utilities other RAID products ship with...
Geeky Q #2: How much data does TR encompass, and to what medium are backups performed? Does the backup software handle live databases? We perform both disk-to-disk and backup to LTO-3 for our data, but we do not typically backup database files. If you need any advice or have any questions in this area, let me know.
Geeky Q #3: What platform and networking topology does TR use? For our production network we are all Gb with link aggregation for our backbone connections and single Gb links for each client. Our horsepower is for production and local file serving, so we do not require fat pipes to the internet. Also, I am no network guru, but I have put several together and have researched a range of products.
No problem if you prefer to be guarded about these details, I know I would. Just offering any help that I can...
Quote:
look, i know everyone was frustrated, and Mike, i know you were just venting.. like i said no hard feelings..
i want to make sure everyone understands the situation..
I noticed a few lost posts, but I experienced no frustration. Your attention to detail, sensitivity to user needs, and tireless effort is exceptional and much appreciated.
Mike I'm sorry if I came across as judging, I did not mean it that way. The first line in your post got to me when you wanted to add to the grief poor Rob already has! Didn't mean to offend you mate.
SCSI, oh wow haven't seen a SCSI device in years! Daisy chaining was awesome! Chaining 5 to 10 GB harddrives, now we have flash cards with 10gb! Amazing how technology gets better and better!
__________________ Clarence 55g sumpless mixed reef(soon to be 120g)
DSB(2 to 6 inches)aprox. 80 lbs,LR aprox. 60 t0 80 lbs.,Coralife 220 Protein Skimmer,CPR HOB Refugium with Fiji Mud Member of TRS Member of SDMAS
RIP Sarracino Ciro 12/16/04 - 4/3/08
The Following User Says Thank You to Pescaiolo For This Useful Post:
SCSI, oh wow haven't seen a SCSI device in years! Daisy chaining was awesome! Chaining 5 to 10 GB harddrives, now we have flash cards with 10gb! Amazing how technology gets better and better!
SCSI is considerably less hot-pluggable like USB and Firewire, but is still a high-performance (Ultra320-SCSI @ 320MBps, Ultra640-SCSI @ 640MBps), reliable technology still implemented for server side RAID systems and backup tape libraries and other demanding devices. By comparison, we use fibre channel for our RAID arrays, which has max throughputs of 250MB/s (2Gb) and 500MB/s (4Gb). You can see how SCSI is still holding its own.
We've been through many backup, delivery, and sneaker-net mediums over the years, including 3.5" floppy, Magneto-Optical, Syquest, Jaz, Zip, and CD-R, DVD-R and now thumb drives. For our servers we used to back up to DAT and then DLT-7000 and now nearline storage and LTO-3. We sometimes need to resurrect legacy data and are generally pack-rats, so we have kept most of these relic drives in storage just in case. For example, we recently had a bygone client request 13+ year old audio files off of DA-88 tapes!!! I try to migrate more useful data from old medium to new medium when I can, but it is hard to keep up...
As far as hard disk space is concerned, we used to do our production within 450 GB. Back then that was a good amount. Now we have over 15 TB, and I still find it challenging to keep the RAIDs from filling up. Television production is all about HDTV nowadays, so our data requirements have exploded...
I'll shut up now, except to say: Much sympathy to Rob!
just wait until i start talking about SCSI buses and I/O boards.. or even quad port NICS with teamed interfaces and failover paths...
SCSI buses, I/O boards, quad port NICS, teamed interfaces, failover paths, Magneto-Optical, Syquest, Jaz, Zip, and CD-R, DVD-R, DAT, DLT-7000, nearline storage, LTO-3, Daisy chaining. What in the world??? That's all greek, no Arabic to me. All I know about the outage is this...
Before the outage I never saw my ad on TR, nor anyone else's. Rob assured mine was in rotation with the others. He could see them, others could see them but I couldn't see them. Then I went on a road trip, took my laptop and broadband card and lo and behold there was all the ads.
Now, since the "fix" Rob had to implement, I'm seeing the ads on my PC.
Thanks Rob.
I'm telling you this computer stuff is wizardry.
Dick
__________________ Amphibious
Reaching my 70th BD, I realize that I cannot help but grow old. However, I refuse to grow up!!! My wife would tell you, "He may be 70 but, He's going on 17". Life is wonderful with a woman like that.
SCSI buses, I/O boards, quad port NICS, teamed interfaces, failover paths, Magneto-Optical, Syquest, Jaz, Zip, and CD-R, DVD-R, DAT, DLT-7000, nearline storage, LTO-3, Daisy chaining. What in the world??? That's all greek, no Arabic to me. All I know about the outage is this...
Before the outage I never saw my ad on TR, nor anyone else's. Rob assured mine was in rotation with the others. He could see them, others could see them but I couldn't see them. Then I went on a road trip, took my laptop and broadband card and lo and behold there was all the ads.
Now, since the "fix" Rob had to implement, I'm seeing the ads on my PC.
Reaching my 70th BD, I realize that I cannot help but grow old. However, I refuse to grow up!!! My wife would tell you, "He may be 70 but, He's going on 17". Life is wonderful with a woman like that.
Before the outage I never saw my ad on TR, nor anyone else's. Rob assured mine was in rotation with the others. He could see them, others could see them but I couldn't see them. Then I went on a road trip, took my laptop and broadband card and lo and behold there was all the ads.
Ampage, i touched up your pic file to give you a dark Hitler mo instead of white i think thats what stopped you from seeing the banner adverts lol
Yeah, Rob is the man...but alas this is an old thread from December. This most recent outage hasn't been discussed yet, which is weird. Seems like it was at least 2 days long.
I feel bad for Rob. We only hear from the guy when he makes announcements. He doesn't seem to have time to just chat with us anymore....
yes sorry about that guys.. had an attack on the server on top of some confusion between me and the operators in the data center. the outage was due to an internal DOS attack and having to rebuild the server (was faster than finding the compromise.
__________________
Show people you appreciate there advice, click the icon under there name and give them Reputation points
lol, it's funny how acronyms can have so many meanings
__________________ "Noone cares how much you know, untill they know how much you care."
"Fear Leads to anger, anger leads to hate, hate leads to suffering"
Thanks for the rescue rob, it would be nice to see you more often though.
after seeing that movie the invisible man you thought it was cool to roam the halls in that way didn't you..lol I thought i heard some heavy breathing last time i started undressing!
icon under their name to add to their reputation. 
i think thats what stopped you from seeing the banner adverts 
V-series Productions 
