random complexity

with a side of crazy

Archive for November, 2010

Random life and philosophy update

fair trade logos and victory gin

Recently I noticed there's a lot of talk going on about fair trade coffee. Is it just me or does this sounds remarkably similar to Victory Gin from Orwell's 1984. In fact, even the fair trade logos (there's heaps) share some subtle similarties. I think I really need to read 1984 again, as it's been many years and even though it might have been written a long time ago in a totally different world to which we live today, maybe Orwell could see what was going to happen, perhaps it was already in motion for some time when he wrote.

Although I have recently watched another conspiracy documentary. All very scary, all very how could we let this happen. Sure take it with a grain of salt and all, but I still don't like the way so many things are heading. The writing on the wall isn't great (though I do appreciate artistic graffiti) and that makes you wonder if there is some grand plan being followed (religion or alien perhaps) or if it's just the illusion of power at the top that drives us all. Orwell touched on that, Equilibrium did too. Hopefully as in both, freedom and freewill will prevail. Without freedom what is the point?

Has anyone else noticed the gradual dumbing down of the workforce and population. It seems most people really are sheep and just do as they're told, think as they're told and essentially live their whole lives as someone/something else intended them to. I think we're losing the ability to make decisions and we're just stuck in a loop of a routine. At work people have even lost the view of the whole, maybe they never saw/understood the big picture, but I've seen a lot of "work" being done because higher up said so, despite it negatively impacting others work or even causing loss of service to the customers. No wonder IT in general has a bad image in most (if not all) workplaces. There's a total lack of consideration/compassion. To be part of this mess makes me feel bad inside. I pride myself in doing quality work, and when the powers that be dictate otherwise it actually hurts me.

That segues nicely into some great news. Recently I quit my job of 6(+2) years to focus on mental clarity and meaningful work. After some weeks doing stuff I've needed to do for ages, I've now entered the job search game, and hope to have a new, meaningful job sometime soon. With all this time on my hands I've actually achieved so much. I've finished some programming projects that have been shelved for ages, I've completed some other time consuming tasks that needed focus and time to achieve. Above all though is the process of clearing my mind. Part of this mental purge is to clean up the house. I've accumulated way too much crap, and a lot of it has to go. So I'm going to sell some stuff on ebay and reduce. Looking back it's easy to see what you use and what you don't. Even if you think you'd use something or would like to use something, if you haven't in years, what's the chance of you using it in the next few years and by then is it even still relevant. I'm not yet factoring in how much keeping things costs me in terms of volume occupied or mental effort to maintain it, that might be the tipping point from a good exercise to going somewhat crazy.

I've read a lot about Minimalism lately and most of it sounds great to me, I'm not sure how to apply all of the ideas to my life. Or warp my life around it to make things work. Sure it might just be a phase, but it does make sense to me, and I've been writing that less is more and the more you have the more problems you have, for quite some time now. It's just now I have the time to put it into practice, and it's making me feel really good. Forcing yourself to justify things seems to make you realise so much about yourself and how you even think. All very deep and meaningful, and the other benefit is the house has never been cleaner. I've been keeping notes on what I've been doing, and who knows I might even turn it into an ebook (to follow in the path of the other great successful minimalists).

More hardwarey storagey stuff

A while back I bought some OCZ Vertex 2 (sandforce based) ssd's, which dropped in price 2 weeks later (as expected). I put one into my desktop when I rebuilt it, which was great, now there's definitely no bottleneck on IO, and even though it's only got 4gb of ram (shared video too - so more like 3.5gb) it now has fast swap. Obviously you don't want to swap ever, but if you do start dipping into swap you'd prefer it to be fast and not impacted by other random IO on the disk, so the ssd is great.

The other 2 ssd's I bought to use as a cache on my primary filer box. ZFS lets you have external caches for both read and write. The write cache is like the journal on a classic file system and is called the ZFS Intent Log (or ZIL). When the ZIL is external to the zpool, it's commonly called a separate log, or slog device. As the file system is built with failure in mind, you need to be aware of the various failure situations if you lose different devices. Losing the ZIL is bad, but no longer catastrophic (it used to be). Now you'll just lose all uncommitted changes to the disk, which is fine, and it won't corrupt the pool. Obviously losing data is bad, and it's always been recommended that the ZIL be on mirrored storage. To select the size of the ZIL there are some calculations related to how much data can be written in 10 seconds (and it's flushed out at least every 10 seconds), and also taking into account system RAM size too. Aiming way too high (but catering for growth maybe) I set mine at 8gb, mirrored.

The rest of the ssd's were to become the read cache, known as the L2ARC cache. The ARC (adjustable replacement cache) cache is a purely in ram cache, and L2ARC is the second level version to be used on fast secondary storage devices like 15K drives or ssds. Objects in this cache are still checksummed, so a device going bad can't corrupt anything (if cache is bad, just read off the primary storage). Due to this there is no point mirroring the read cache and by adding multiple devices you essentially stripe your cache, which is good. So the 2 ssd's were sliced up (Solaris partitions) with an 8gb slice for the mirrored ZIL, and the rest for the L2ARC. Using 60gb ssd's I've now got over 90gb of high speed read cache, the theory is this cache could read at over 500MB/s, in practice it's hard to tell. At least the ssd's are rated at 50000 IOPS for 4k random writes.

ssd partition layout

Half the idea behind all this was to improve power management. Say you're watching a film, the whole file can be pre-read into cache and then while watching, it can be served purely from the cache while the main disks have spun down. ZFS apparently has some very neat caching algorithms in it, and I'm probably not seeing the best behaviour because the box doesn't have sufficient system ram (only 2gb), but in it's defence it is a 5 year old box. A rebuild (apart from disks) is long overdue.

So to actually do all this, once the disk is sliced up (using format) you can simply add the log and cache vdev's as follows (with your device names):

zpool add <poolname> log mirror c2d0s1 c3d0s1
zpool add <poolname> cache c2d0s3 c3d0s3

Or if you were building the zpool from scratch (say with 8 disks) and all the above craziness (as you do):

zpool create <poolname> raidz2 c0t0d0 c0t1d0 c0t2d0 c0t3d0 c0t4d0 c0t5d0 c0t6d0 c0t7d0 \
     log mirror c2d0s1 c3d0s1 cache c2d0s3 c3d0s3

Which would leave you with a pool along these lines (once you've put heaps of data on it):

# zpool status
 pool: yawn
 state: ONLINE
 scrub: scrub completed after 14h31m with 0 errors on Wed Nov 17 01:41:46 2010
config:

        NAME        STATE     READ WRITE CKSUM
        yawn        ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            c0t0d0  ONLINE       0     0     0
            c0t1d0  ONLINE       0     0     0
            c0t2d0  ONLINE       0     0     0
            c0t3d0  ONLINE       0     0     0
            c0t4d0  ONLINE       0     0     0
            c0t5d0  ONLINE       0     0     0
            c0t6d0  ONLINE       0     0     0
            c0t7d0  ONLINE       0     0     0
        logs
          mirror-1  ONLINE       0     0     0
            c2d0s1  ONLINE       0     0     0
            c3d0s1  ONLINE       0     0     0
        cache
          c2d0s3    ONLINE       0     0     0
          c3d0s3    ONLINE       0     0     0

errors: No known data errors

# zpool iostat -v
               capacity     operations    bandwidth
pool        alloc   free   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
yawn        12.7T  1.81T     26      5  3.20M   482K
  raidz2    12.7T  1.81T     26      5  3.20M   440K
    c0t0d0      -      -      6      1   550K  73.8K
    c0t1d0      -      -      6      1   550K  73.8K
    c0t2d0      -      -      6      1   550K  73.8K
    c0t3d0      -      -      6      1   550K  73.8K
    c0t4d0      -      -      6      1   550K  73.8K
    c0t5d0      -      -      6      1   550K  73.8K
    c0t6d0      -      -      6      1   550K  73.8K
    c0t7d0      -      -      6      1   550K  73.8K
  mirror    11.9M  7.99G      0      0      0  41.4K
    c2d0s1      -      -      0      0      0  41.4K
    c3d0s1      -      -      0      0      0  41.4K
cache           -      -      -      -      -      -
  c2d0s3    46.8G     8M      0      0  16.8K  98.6K
  c3d0s3    46.8G     8M      0      0  16.8K  98.3K
----------  -----  -----  -----  -----  -----  -----

Later if you ever need to, you can remove these cache/slog devices, say you wanted to use the ssd's elsewhere or needed the sata ports for other spinning disks. Cache can be removed from any version, and slog/zil can be removed as long as you're on zpool version 19 or above. You just have to be careful which command you use, like when adding devices as they each have different meaning.

zpool remove - removes a cache device or top level vdev (mirror of logs only). Mirror vdev name comes from the zpool status output.

zpool remove yawn c3d0s3
zpool remove yawn mirror-1

zpool detach - detaches a disk from a mirror vdev (can return it to a single device vdev if you remove the second last disk). Example below detaches c3d0s1 from a mirror, if it's not a mirror the command will error out. Detach works on any mirror vdev, not just logs.

zpool detach yawn c3d0s1

zpool attach - makes a mirror out of an existing vdev (single device, or mirror) Example attaches new device c3d0s1 as a mirror of already present device c2d0s1. Attach also works on any vdev, not just logs.

zpool attach yawn c2d0s1 c3d0s1

After using ZFS for over 2 years now I've come to really appreciate it. There's a definite learning curve to it, but no more than equivalent on Linux. Linux Raid + LVM + + how to resize/reshape and so on. Actually zfs might be simpler, as all the commands are clearly documented in one place and behave all the same. The best part of ZFS is knowing your data is not rotting away on disk, and the very easy incremental replication, and snapshots, and Solaris's smoking fast NFS server, and and and

Copyright © 2001-2016 Robert Harrison. Powered by hampsters on a wheel. RSS.