|
(tiny) Life At Stack Overflow: My Developers Are Smarter Than Your DBAs
-
nickcraver.com
-
10 years ago
-
eng
My Developers Are Smarter Than Your DBAs by @Nick_Craver What would you say...you do here? Last month at Stack Overflow: 1,468,389,303 Page Views 5,183,954,727 HTTP Hits 71,562,833,811,315 Bytes Sent 3,202,505,376 CDN Hits 54,400,000,000,000 CDN Bytes 19,532,899,854 SQL Queries 81,505,688,410 Redis Ops 18.2ms Average Render Time ...at roughly 5-10% capacity How do we do that? Go that way, really....
|
The following are benchmarks from our testings of our iSCSI SSD storage. 67,300 read IOP/s on a VM on iSCSI (Disk -> LVM -> MDADM -> DRBD -> iSCSI target -> Network -> XenServer iSCSI Client -> VM) Per VM and scales to 1,000,000 IOP/s total root@dev-samm:/mnt/pmt1 128 # fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=128 --size=2G --readwrite=read test: ( g = 0 )....
|
|
(tiny) Life At Stack Overflow: My Developers Are Smarter Than Your DBAs
-
nickcraver.com
-
10 years ago
-
eng
My Developers Are Smarter Than Your DBAs by @Nick_Craver What would you say...you do here? Last month at Stack Overflow: 1,468,389,303 Page Views 5,183,954,727 HTTP Hits 71,562,833,811,315 Bytes Sent 3,202,505,376 CDN Hits 54,400,000,000,000 CDN Bytes 19,532,899,854 SQL Queries 81,505,688,410 Redis Ops 18.2ms Average Render Time ...at roughly 5-10% capacity How do we do that? Go that way, really....
|
|
The following are benchmarks from our testings of our iSCSI SSD storage. 67,300 read IOP/s on a VM on iSCSI (Disk -> LVM -> MDADM -> DRBD -> iSCSI target -> Network -> XenServer iSCSI Client -> VM) Per VM and scales to 1,000,000 IOP/s total root@dev-samm:/mnt/pmt1 128 # fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=128 --size=2G --readwrite=read test: ( g = 0 )....
|
|
Git submodules are actually a very beautiful thing. You might prefer the word powerful or elegant, but that’s not the point. The downside is that they are sometimes misused, so as always, use with care. I’ve used them in projects like puppet-gluster , oh-my-vagrant , and others. If you’re not familiar with them, do a bit of reading and come back later, I’ll wait. I recently did some work packaging Oh-My-Vagrant as RPM’s . My primary g..
|
|
Git submodules are actually a very beautiful thing. You might prefer the word powerful or elegant, but that’s not the point. The downside is that they are sometimes misused, so as always, use with care. I’ve used them in projects like puppet-gluster , oh-my-vagrant , and others. If you’re not familiar with them, do a bit of reading and come back later, I’ll wait. I recently did some work packaging Oh-My-Vagrant as RPM’s . My primary g..
|
|
There are three browser tabs continously used in my workflow: GMail, Google Calendar, and Google Play Music. I normally have many more tabs open, but these three I access periodically. As the number of open tabs increases, and I fail to cleanup, getting back to my usual three gets a little trickier. So far, I've kept each of these services open in separate windows. But that doesn't always work. Click on any link in your inbox and you're b..
|
|
Event sourcing is a very powerful tool that allows you to capture information you didn't even know you wanted. One of the things you usually…
|
|
You’ve built your product and you’re now ready for your first major launch. Or you’ve been through a launch or two, but are looking to scale the process as you’re doing more launches and announcements. You really have two options: do it all on your own , or work with a PR agency. One frequent crossroad is that you’re not at the point of a full time PR person, but unsure what a PR agency can offer you; and, further what’s the best way to wo....
|
|
You’ve built your product and you’re now ready for your first major launch. Or you’ve been through a launch or two, but are looking to scale the process as you’re doing more launches and announcements. You really have two options: do it all on your own , or work with a PR agency. One frequent crossroad is that you’re not at the point of a full time PR person, but unsure what a PR agency can offer you; and, further what’s the best way to wo....
|
|
Having a reliable test suite should always be the goal in software development. After all if you can’t trust the tests then why bother running them at all? This is especially important in a shared coding environment and when running through Continuous Integration (CI). 1 - Test in Isolation It may seem obvious but writing focused tests which do a single thing is one of the most effective ways to avoid them being flaky. Tests which do mu..
|
|
I was talking to someone, who we’ll call Michael (because that’s his name), about the truck life and this blog, and he said, “You know, it’d be cool if you had a place on the site where you could see how much money you’ve saved.” Well Michael, I agree with you wholeheartedly, so starting today, there’ll be a live-updating clock on the right left side (or bottom on mobile) of the page that shows the amount of money I’ve saved by living in ..
|
|
I was talking to someone, who we’ll call Michael (because that’s his name), about the truck life and this blog, and he said, “You know, it’d be cool if you had a place on the site where you could see how much money you’ve saved.” Well Michael, I agree with you wholeheartedly, so starting today, there’ll be a live-updating clock on the right left side (or bottom on mobile) of the page that shows the amount of money I’ve saved by living in ..
|
|
Evaluating Splatoon’s Ranking System — Using probability theory to uncover a subtle bug in Splatoon.
|
|
A modified version of John Sutton’s rcd_serial cable coupled with our Supermicro reset switch hijacker: This works with the rcd_serial fence agent plugin . Reasons rcd_serial makes for a very good STONITH mechanism: It has no dependency on power state. It has no dependency on network state. It has no dependency on node operational state. It has no dependency on external hardware. It costs less that $5 + time to build. It is in..
|
|
A modified version of John Sutton’s rcd_serial cable coupled with our Supermicro reset switch hijacker: This works with the rcd_serial fence agent plugin . Reasons rcd_serial makes for a very good STONITH mechanism: It has no dependency on power state. It has no dependency on network state. It has no dependency on node operational state. It has no dependency on external hardware. It costs less that $5 + time to build. It is in..
|
|
Last update: April 16th, 2017 Microsoft’s marketing department often names its products in names that don’t reveal anything about their “real” version numbers. Recently it’s mainly years, like “Visual Studio 2015” but it could be numbers which don’t correspond to The post Microsoft Developer Products Version & Release Numbers appeared first on FullStack - Ofer Zelig's Blog .
|
|
Why does all software contain bugs?” this was a question recently asked of me. My response at the time was because all software is not perfect, but is this true? Lets take a very simple example. public class Hello { public static void main(String[] args) { System.out.println("Hello World!"); } } The above example is arguably the simplest program that can be written using Java. It also happens to be the first program usually writt..
|
|
I read an article earlier today called The self-hating Web Developer that I found on Hacker News and it bothered me. It resonated with me as something that I professionally internalized over my career but it bothered me because Joseph encountered personal financial difficulty for both himself and his family due to the struggle. For that reason (and insomnia), I feel compelled to write this as reference to refer to for anybody else who may b..
|
|
I’m not talking about securing in the sense of safety and making something inaccessible, but rather in making sure something stays static relative to its container. When you’re setting up your room or a new piece of furniture, generally the last thing on your mind is making sure it stays in place. It’s basically just a given that your various belongings aren’t going to wander around when you aren’t in the room. I knew from the start that ..
|
|
I’m not talking about securing in the sense of safety and making something inaccessible, but rather in making sure something stays static relative to its container. When you’re setting up your room or a new piece of furniture, generally the last thing on your mind is making sure it stays in place. It’s basically just a given that your various belongings aren’t going to wander around when you aren’t in the room. I knew from the start that ..
|
|
Currently in the world of JavaScript these options are what we most commonly use to generate logs: console.log console.info console.warn console.error These are actually pretty good in most modern browsers. Even if you go back to Internet Explorer 8 console.log and friends work as long as you have the developer tools open. Given that we have these logging utilities what is the problem with using them? When in local development these are j..
|
|
Alghero. Baja Sardinia. Budoni. Cala Goloritze, Sardinia . Castelsardo (gifts maybe?). Food: Maialetto sardo (Pig), Sebadas, Pardula, Papassinas, Pani e sapa. L'Asinara boat trip (abandoned penitentiary). La Pelosa beach. Nuraghe. Porto Cervo. Porto Torres. San Teodoro. Stintino (fishing port). Zedda e Piras vinyards (Alghero).
|
|
I’m learning Python, and have had fun automating tasks with Python scripts. I was polluting my Macbook (Yosemite) quite a bit by installing all libraries globally, until I learned about Vagrant . Vagrant is essentially a command-line wrapper around VirtualBox. It makes it easy to create/configure/destroy virtual machines from the shell. Vagrantfile ¶ I installed it from here . A summary of my journey is below. Created and jumped i..
|
Traditionally mirrored disk sets in Linux and other operating systems have been limited to two devices. While mirroring has the benefit over other raid levels in that each mirrored device contains a complete copy of the data, the two device limit became inadequate as disk sizes ballooned. In the age of multi-TB drives, simply rebuilding a degraded mirrored array could actually cause the surviving device to fail, eliminating the very redunda..
|
|
My trip to Italy last year was the first time I’d ever been overseas. Most of the trip was spent walking across Tuscany and Umbria.
|
|
If you’re familiar with nearly any mainstream programming language, and I asked you to draw a diagram of an array, the array indices, and the array elements, odds are good you’d produce a diagram something like this: In this post, I want to persuade you to replace that image, or, at least, to augment it with an alternate view on the world. I want to argue that, rather than numbering elements of an array, it makes just as much sense, and in ..
|
|
If you’re familiar with nearly any mainstream programming language, and I asked you to draw a diagram of an array, the array indices, and the array elements, odds are good you’d produce a diagram something like this: In this post, I want to persuade you to replace that image, or, at least, to augment it with an alternate view on the world. I want to argue that, rather than numbering elements of an array, it makes just as much sense, and in ..
|
|
One of the things that has always bothered me about searchcode.com was that it never generated any money. Not a huge problem in itself as a side project, but the costs to run it are not insignificant due to the server requirements. I had looked into soliciting donations but I considered this highly unlikely to produce enough revenue to cover costs considering that sites such as gwern.net was unable to make enough to cover even basic costs..
|
|
The birthday paradox observes that in a room of 23 people, the odds that at least two people share a birthday is 50% The same logic that drives matching birthdays also drives the probability that one can find collisions with a hash function. In other words, if you have a uniform hashing function that outputs a value between 1 and 365 for any input, the probability that two hashes would collide in a set of 23 values is also 50% Another....
|
|
Whether it's Makefile, SConstruct, BUILD, or your favorite build file, chances are you have to tweak it from time to time. ar/open-build-file searches your current and parent directories to find a build file. (defvar ar/project-file-names '("Makefile" "SConstruct" "BUILD")) (defun ar/parent-directory (path) "Get parent directory for PATH." (unless (equal "/" path) (file-name-directory (directory-file-name path)))) (defun ar/find-upwards....
|
|
Looking for a quick guide to Net Promoter Score? You’ve found it. This little guide will give you all the basics.
|
|
Fixing regression bugs is analogous to digging a hole only to find the next day it has been filled in and having to dig it out again” Ask any manager, developer or tester working on software without tests what the main pain points are. Nearly all the time the main one mentioned is dealing with regressions. This is bugs that were fixed a year ago which returned. Regression bugs cost the software industry billions of dollars a year. Worse..
|
|
In Charting the Waters , I mentioned two books that I picked up to get myself in the travel mindset. Last week, I set aside an hour and read through the lighter of the two: How to Drop Everything And Travel Around The World . Thoughts Overall, I thought the book was a worthwhile read. As far as actual, concrete information about travel and destinations, it was pretty light (the whole thing is only 56 pages), but it was cert..
|
|
In Charting the Waters , I mentioned two books that I picked up to get myself in the travel mindset. Last week, I set aside an hour and read through the lighter of the two: How to Drop Everything And Travel Around The World . Thoughts Overall, I thought the book was a worthwhile read. As far as actual, concrete information about travel and destinations, it was pretty light (the whole thing is only 56 pages), but it was cert..
|