Testing in Production

Question

Testing in Production

Steve Jones - SSC Editor

SSC Guru

Points: 736212
More actions
September 22, 2014 at 8:45 pm

#290217

Comments posted to this topic are about the item Testing in Production

Viewing 15 posts - 1 through 15 (of 36 total)

You must be logged in to reply to this topic. Login to reply

Gary Varga SSC Guru Points: 82166 More actions · Answer 1

I would like to think that Apple was frugal with this campaign and have seen the error of their ways.

This was totally a predictable scenario. If anyone knows how many people are interested in the Apple events then it should be Apple. They should know how many potential devices could connect. Plus you should always cater for more. Who runs utilisation at 100%???

They must have saved a few bob (US citizens read bucks - Rest of the World this is a monetary reference) on their marketing campaign too after all "bigger is bigger". What? Yes, that's right!!!

Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!

venoym SSCarpal Tunnel Points: 4161 More actions · Answer 2

Shall I make the obvious comment? "Safari can't crash, Apple engineers it to be bullet-proof" (yes, I've actually heard a fanboi say that).

Gary Varga SSC Guru Points: 82166 More actions · Answer 3

venoym (9/23/2014)
Shall I make the obvious comment? "Safari can't crash, Apple engineers it to be bullet-proof" (yes, I've actually heard a fanboi say that).

Thanks venoym. You have made my day.

I despise fanbois and fangrrls for their sheer bind stupidity. It is beyond enthusiasm. This is not limited to Apple fanbois. Nor even technology fanbois. They are fundamental extremists i.e. unless you agree with them you are wrong. Even then you are not quite as right as them either. Grrrrr.

Oh thanks venoym. I'm all angry now!!!

Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!

Dan Guzman SSCommitted Points: 1506 More actions · Answer 4

How much did the choppy video and connection errors really cost Apple in terms of lost revenue or reputation? Testing their CDN performance using a world-wide bot network isn't cheap. Perhaps the decision makers did weigh the risks and rewards of thorough iterative testing, and the risk of their CDN not meeting SLAs or that demand exceeded capacity did not justify cost. Apple undoubtedly knew few customers would not upgrade just because they missed some live streaming hype so, assuming they did not test, that may have been a conscious business decision.

OCTom SSChampion Points: 11785 More actions · Answer 5

I don't think that matters when it comes to Apple. Apple customers are so rabid that any glitch at all is overlooked. It certainly didn't hurt sales.

Tom

djackson 22568 SSChampion Points: 11733 More actions · Answer 6

I doubt it was Apple, recall that the government gave permission to comcast and others to throttle bandwidth unless the provider pays them. Open Internet at its finest!

To the point of your post, though, some companies get it right, others don't. A few years back Best Buy had horrible performance on Black Friday, while Amazon and others did great. The last couple of years Best Buy has really done a better job. How does a company handle 1,000 times the number of hits on a single day or two? You can't purchase enough hardware for such an increase and remain competitive. Amazon can due to their very deep pockets, and selling their hosting services. Fortunately, or unfortunately, most companies don't see that scale of increase for anything.

Dave

matt.ashmore2002 Grasshopper Points: 12 More actions · Answer 7

I would say even if you are Akamai, and they do streaming for a business, it would still be impossible to load test a streaming event for every possible browser situation out there. So, sometimes you have to do the best you can and put it out there. Just my thoughts,

Matt Ashmore

Sean Lange SSC Guru Points: 286590 More actions · Answer 8

I will just leave this here.

_______________________________________________________________

Need help? Help us help you.

Read the article at http://www.sqlservercentral.com/articles/Best+Practices/61537/ for best practices on asking questions.

Need to split a string? Try Jeff Modens splitter http://www.sqlservercentral.com/articles/Tally+Table/72993/.

Cross Tabs and Pivots, Part 1 – Converting Rows to Columns - http://www.sqlservercentral.com/articles/T-SQL/63681/
Cross Tabs and Pivots, Part 2 - Dynamic Cross Tabs - http://www.sqlservercentral.com/articles/Crosstab/65048/
Understanding and Using APPLY (Part 1) - http://www.sqlservercentral.com/articles/APPLY/69953/
Understanding and Using APPLY (Part 2) - http://www.sqlservercentral.com/articles/APPLY/69954/

matt.ashmore2002 Grasshopper Points: 12 More actions · Answer 9

matt.ashmore2002

Grasshopper

Points: 12

September 23, 2014 at 7:45 am

#1747466

Correct. I agree.

Steve Jones - SSC Editor SSC Guru Points: 736212 More actions · Answer 10

Sean Lange (9/23/2014)
I will just leave this here.

Noooooooooooooooooooooooooooooooooooooooooooooooooooooooooo

Sean Lange SSC Guru Points: 286590 More actions · Answer 11

Steve Jones - SSC Editor (9/23/2014)
Sean Lange (9/23/2014)
I will just leave this here.
Noooooooooooooooooooooooooooooooooooooooooooooooooooooooooo

hehe

_______________________________________________________________

Need help? Help us help you.

Read the article at http://www.sqlservercentral.com/articles/Best+Practices/61537/ for best practices on asking questions.

Need to split a string? Try Jeff Modens splitter http://www.sqlservercentral.com/articles/Tally+Table/72993/.

Cross Tabs and Pivots, Part 1 – Converting Rows to Columns - http://www.sqlservercentral.com/articles/T-SQL/63681/
Cross Tabs and Pivots, Part 2 - Dynamic Cross Tabs - http://www.sqlservercentral.com/articles/Crosstab/65048/
Understanding and Using APPLY (Part 1) - http://www.sqlservercentral.com/articles/APPLY/69953/
Understanding and Using APPLY (Part 2) - http://www.sqlservercentral.com/articles/APPLY/69954/

Gary Varga SSC Guru Points: 82166 More actions · Answer 12

Sean Lange (9/23/2014)
Steve Jones - SSC Editor (9/23/2014)
Sean Lange (9/23/2014)
I will just leave this here.
Noooooooooooooooooooooooooooooooooooooooooooooooooooooooooo
hehe

Qui?

Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!

Steve Jones - SSC Editor SSC Guru Points: 736212 More actions · Answer 13

Dan Guzman-481633 (9/23/2014)
How much did the choppy video and connection errors really cost Apple in terms of lost revenue or reputation? Testing their CDN performance using a world-wide bot network isn't cheap. Perhaps the decision makers did weigh the risks and rewards of thorough iterative testing, and the risk of their CDN not meeting SLAs or that demand exceeded capacity did not justify cost. Apple undoubtedly knew few customers would not upgrade just because they missed some live streaming hype so, assuming they did not test, that may have been a conscious business decision.

Likely not much in this case. Certainly the sales this past week show that lots of people were ready to upgrade, and the talk was available later. No shortage of press, and the issues apparently weren't discussed much later.

However this isn't really just about Apple. While they might have gotten past it, I suspect a few people working at Apple might no longer be doing so. Or even some subcontractors shown the door. I'd argue that most of us shouldn't take the chance and do our best to simulate and test prior to deploying changes.

Chad Slagle SSC Veteran Points: 200 More actions · Answer 14

Iphone users.. How is your black and white TV still working? Did you get your Neil Sedaka records loaded into your ITunes library yet? Does your back hurt from doing the Charleston? Have you heard that that new band, you too (lazy little whipper snappers.. always abbreviating.. not on your watch right)? How is that bigger screen, can it accommodate more apps on the screen now, being that you are using the 24pt font setting?

😀