File system testing with large amounts of files.

When you start playing with thousands of files, you may get the following message:
"Waiting for slave synchronization: "

In the next version the message text changes to:
"Waiting for slave synchronization: Building and validating file structure(s) "

When Vdbench internally builds the file and directory structure there are two things that can take a while:
- Allocating about 60 bytes of memory for each file in the Java Heap, and Java doing a lot of Garbage Collection to find all that.
- If the directory structure already exists Vdbench needs to keep going to the directory to find out: "does the file exist", and 'How long is it".

This all can take quite a while if you're dealing with huge amounts of files.
Comments:

Post a Comment:
  • HTML Syntax: NOT allowed
About

Blog for Henk Vandenbergh, author of Vdbench, and Sun StorageTek Workload Analysis Tool (Swat). This blog is used to keep you up to date about anything revolving around Swat and Vdbench.

Search

Categories
Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today