OUR NETWORK:TiVo Community  TechLore  Sling Community  My DigitalEntertainer  Presto Place  See all... About UsAdvertiseContact Us

 
Learn about scoring Forum's Raw Score: 170652.0
May 1, 2008 11:08 AM

Categories: Networking and Remote Access

Rating (0 votes)
  • 1
  • 2
  • 3
  • 4
  • 5
Rate This!

Member Avatar

Matt Whitlock

  Administrator
Joined: 03/26/2008

Has anyone noticed any major speed differences transferring files to the MediaSmart Server depending on whether or not you're hooked up via Fast Ethernet or Gigabit. What are the realistic speed differences between the two.

Discussion:    Add a Comment | Comments 1-25 of 39 | Latest Comment | 1 2 Next »

May 2, 2008 7:22 AM

I certainly noticed a huge difference with 100Mbps(Fast Ethernet) and 1Gbps(Gigabit).

As a rule of thumb, the potential data rate of Fast Ethernet or 100Mbps, as suggested is 12.5MB per second. With Gigabit or 1Gbps/1000Mbps, you have a potential 125MB per second.

However, there are many factors that will affect these speeds but for me I noticed that with Fast Ethernet, I would get average speeds of around 10-11MB per second transfer rates.

With 1Gbps, I average around 35MB per second. This can often peak at upto 70MB per second but ususally drops back down to the average very quickly.

I think most of these issues are related to drive speeds as well as the way WHS handles the files and disk storage.

NOTE: These transfer rates are to and from my PC to my MediaSmart Server. I get consistently higher speeds when copying between my two PCs, especially over the Gigabit link.

May 2, 2008 12:26 PM

Hi Violation,

Great post. I totally agree with you that the potential speed differences between Gigabit and Fast Ethernet are substantial, but as you hinted, potential and real world performance are two way different things.

35MB per second with peaks of 70 on gigabit compared to 10-11 for fast Ethernet is nothing to baulk at. Based on my experiences with it, the first 100 to 200 MB of a large file goes pretty quickly on both, but then slows down (does it load into RAM first and the slow down from having to move data to disk?)

I'm hoping to do some actual measurements to get real world numbers on both types of networks, but your averages certainly seem to be what I'm experiencing as well.

May 2, 2008 2:18 PM updated: May 2, 2008 2:21 PM

That's a really good question actually. The speeds always seem to start quite high then drop. One thing I did notice that even if I am copying *from* the MSS, the demigrator service will start chewing up resources. This in turn then seems to affect the initial performance of data transfers especially via network. Clearly this is a Windows based issue but I couldn't say exactly what is going on.

Your theory of data being copied to RAM before transfer would make sense though. Especially if there is data scattered across multiple drives.

May 2, 2008 2:31 PM

Given that MSS is "essentially" a Windows based PC, I bet we could do some checking and see if that's how flavors of Windows Server handle file transfers across a network. I imagine it would be similar for Home Server, though with probably more RAM dedicated to the task.

I'm not sure the drive scattering would even be a factor for this, considering the home server does its balancing act separately. It begs the question... During a transfer does data get placed on one drive, or separated out as fast as it can depending on what drives are idle and then balanced after the fact? Hmmmmmm...

Your thoughts?

I haven't really payed attention to transfer speeds when copying data 'from' the MSS, but it sounds like there's some things happening under the hood there as well.

May 2, 2008 2:41 PM updated: May 2, 2008 2:55 PM

Matt Whitlock said: I'm not sure the drive scattering would even be a factor for this, considering the home server does its balancing act separately. It begs the question... During a transfer does data get placed on one drive, or separated out as fast as it can depending on what drives are idle and then balanced after the fact? Hmmmmmm...

I'm not sure either, but what I meant was, if data is scattered across the drives, then maybe the demigrator service is somehow responsible for locatiing, copying those fragments to memory, before transferring via network. I'm just speculating here so feel free to humour me :D

 It'd definately be good to get some clarification on this.

I'm also about 90% convinced that the demigrator service actually starts balancing the data transfer of large files before they are even complete. I reckon this why we see such a drop in performance. Again, this is just speculation though.

May 2, 2008 2:51 PM

Violation said:
Matt Whitlock said: I'm not sure the drive scattering would even be a factor for this, considering the home server does its balancing act separately. It begs the question... During a transfer does data get placed on one drive, or separated out as fast as it can depending on what drives are idle and then balanced after the fact? Hmmmmmm...
I'm not sure either, but what I meant was, if data scattered across the drives, then maybe the demigrator service is somehow responsible for locatiing, copying those fragments to memory, before transferring via network. I'm just speculating here so feel free to humour me :D  It'd definately be good to get some clarification on this. I'm also about 90% convinced that the demigrator service actually starts balancing the data transfer of large files before they are even complete. I reckon this why we see such a drop in performance. Again, this is just speculation though.

Copying from I have a good feeling you're right that the demigrator service is putting everything together in RAM on the send.

Copying to, I was wondering if data is balanced during transfer or just put anywhere then balanced after transfer to increase performance (question is, how much performance impact is there between balancing and just the time it takes to copy to disk).  However, in hindsight, some kind of service that logs where the heck its putting data would have to be required for it to even balance after the fact, right? So maybe --> Network --> RAM --> service starts (slowdown) --> begin copy to disk?  

It's certainly a great question, though I'm not even sure how one could possibly test that.

May 2, 2008 3:00 PM

Ah yes, this would make sense. I presume the "Landing Zone" where data is initially copied to is just a set a side area of disk space where data is stored before it is allocated by balancing. As long as this Landing zone is a mixture of space located from all the drives in your system and not just, lets say the system drive, this would probably be exactly what is happening.

I like the sound of that. Even if it's not right, it still sounds good and I think that'll do me :D

Seriously though, it would be good to know exactly how this functions because then we can tweak the hell out of it :D

Tweaking is good....

May 2, 2008 3:21 PM updated: May 2, 2008 3:22 PM

Violation said: Seriously though, it would be good to know exactly how this functions because then we can tweak the hell out of it :D Tweaking is good....

I may check to see if MS has any white papers on the subject (doubtful, but worth a try). As an avid PC tweaker, the statement "Tweaking is good" is words I live by. I don't care what other people say, a 2% performance increase from tweaking may not be much, but it's still 2%!

I did some poking around the drives on the MSS through remote desktop. I unhid any system files to see if there was a folder that was obviously this fabled "Landing Zone." I didn't see anything that stood out, but there were some empty folders that could be, C:/DE \ D:/DE?

Of course, it could also just use the page file... I could try and watch the folders during a large transfer to see if anything stands out I guess, unless you can think of a better way to test it.

May 2, 2008 3:32 PM updated: May 2, 2008 3:33 PM

Well, I think the paging file was certainly a good start. I'm sure Microsoft have come up with some devious way of disguising the technology behind the Balancing Storage message. I would say that there could well be some clues on the System partition. Possibly in the temporary folders?

Unfortuntely, due to a PSU failure on my EX475 (See my thread under the News/Gossip Section), I am unable to test this at the moment. I am *supposed* to be getting a replacement unit on Tuesday so hopefully I'll be able to have a little look myself.

May 2, 2008 3:40 PM

Violation said: Unfortuntely, due to a PSU failure on my EX475 (See my thread under the News/Gossip Section), I am unable to test this at the moment. I am *supposed* to be getting a replacement unit on Tuesday so hopefully I'll be able to have a little look myself.

That would be great. I saw your other thread and hope you get back up and running again soon.

When that time comes, perhaps we could collaborate on this adventure and put together a guide about it here on the site? I'm always up for trying to figure this kind of stuff out. I'm still a bit new to WHS, but I'm learning quite a bit the more I play with it.

May 2, 2008 3:54 PM

Sounds good. I have to say, I've been using my HP MediaSmart Server since February and I absolutely love it although I'm still fairly new to it! It's a great product and WHS is also very cool.

I think that the more we learn about it, the more we learn how to tweak it and the more widely used it becomes, the better it will become.


I can see it being a standard in the home in a few years to come...

....in mine anyway :D

May 2, 2008 10:43 PM

The size of the landing zone is the size of your system drive minus 20Gb for WHS itself. Microsoft recommends using your largest drive as the system drive because of limitations in Drive Extender. The space on your D: drive is the remainder of your system drive. The free space on D: is the limiting factor when doing file copies to the server.

May 5, 2008 4:46 PM updated: May 5, 2008 4:49 PM

I've been running a gigabit network at home since 2001. It definitely makes transfers so much quicker.
My transfers to my MSS average around 250mbs.

8TB MSS(11 WD 750GB GP drives), CFI port Multiplier, 4 bay USB, 2GB, LE-1640

May 6, 2008 11:35 AM

Hey Violation,

It's Tuesday... did you hear anything about your replacement as of yet?

May 7, 2008 9:40 AM

Matt Whitlock said: Hey Violation, It's Tuesday... did you hear anything about your replacement as of yet?

Hello! I can happily report that I DID receive my MediaSmart replacement on Tuesday as HP promised.

My faith is somewhat restored and after some testing, all my data seems intact and I'm well chuffed! I knew you could do it HP, you just needed a little friendly nudge!  :D

 Anyway, I will run this new unit in gently but hopefully that will be the last time I should need to have any replacements. Hopefully the others will get theirs sorted too!

 Anyway, now I can get back to some network throttling to see if we can boost the LAN performance of these puppies! I've heard that there is a driver upgrade that can be used to improve the network performance and gain more consistent speeds for data rates.

May 7, 2008 10:19 AM

Violation said:
Matt Whitlock said: Hey Violation, It's Tuesday... did you hear anything about your replacement as of yet?
Hello! I can happily report that I DID receive my MediaSmart replacement on Tuesday as HP promised. My faith is somewhat restored and after some testing, all my data seems intact and I'm well chuffed! I knew you could do it HP, you just needed a little friendly nudge!  :D  Anyway, I will run this new unit in gently but hopefully that will be the last time I should need to have any replacements. Hopefully the others will get theirs sorted too!  Anyway, now I can get back to some network throttling to see if we can boost the LAN performance of these puppies! I've heard that there is a driver upgrade that can be used to improve the network performance and gain more consistent speeds for data rates.

Woot! Three cheers!

Glad you're back in the saddle! I knew it would work out.

Okay, driver upgrades are a great place to start. According to the Device Manager in the EX475, the Network Adapter is the SiS191 1000/100/10... REV_01 based on what I can tell.   Do you see something similar in yours?

May 7, 2008 11:34 AM

Matt Whitlock said:  According to the Device Manager in the EX475, the Network Adapter is the SiS191 1000/100/10... REV_01 based on what I can tell.   Do you see something similar in yours?

Well, what I can see is the driver revision seems to be dated back to 20 Dec 2006. I've read that there is in fact a later driver for this and the results are good. See here

I'm actually quite tempted to try :D

May 7, 2008 12:32 PM updated: May 7, 2008 12:36 PM

Good find. So here's my concern, if I were to install this newer driver package and something goes wrong and I lose my network capabilities, would I not even be able to remote into it to roll back or worse... not be able to use the server restore disc to factory reset it? I'd hate for you to pretty much brick your MSS, particularly since you just got it. ;-)

I've found the SiS driver for the 191, which is now at v 2.05.

Dare we try... Anyone out there braver than me?

May 7, 2008 12:38 PM updated: May 7, 2008 12:39 PM

Well, I've just done it! See the attached screenshot

May 7, 2008 12:42 PM

Sweet! You've definitely got some gumption!

It probably would have made sense to benchmark some things to do some before/after comparisons. Are you noticing any improvements?

May 7, 2008 12:44 PM

Actually, now I'm just waiting for it to finish "Balancing Storage" like it seems to do after pretty much every operation you do :)

May 7, 2008 1:03 PM

When you installed it, did you run the setup.exe file, or just update the driver directly through the device manager?

May 7, 2008 1:04 PM

Now that my system has finished balancing, I can happily report that I too am receiving more consistent results for data transfer.

For example, when copying a 7.5GB file before the driver update, I got transfer speed that peaked at 65MB/s then quickly dropped down to around 35MB/s. Now, I am getting peak rates of around 68MB/s with consistent rates of around 55MB/s. So far, so good. Obviously this needs to be tested over a period of time, but the initial findings look promising :D

May 7, 2008 1:06 PM

Matt Whitlock said: When you installed it, did you run the setup.exe file, or just update the driver directly through the device manager?
I just ran setup.exe. I didn't use the install.bat file that they also include either. That just seems to generate a log file.

May 7, 2008 1:11 PM

That's fantastic news. I'll run my own transfer test now, and then post back with my results afterward. Hopefully I see the same thing that you do.

Discussion:    Add a Comment | Back to Top | Comments 1-25 of 39 | Latest Comment | 1 2 Next »

Add Your Reply

(will not be displayed)

Email me when comments are added to this thread

 
 

Please log in or register to participate in this community!

Log In

Remember

Not a member? Sign up!

Did you forget your password?

close this window
close this window