March 31, 2007

Software QA Certifications - An Aid To Gaining Employment?

"Will obtaining a CSTE or CSQA certification improve my chances at getting a QA job?"


On SQAForums.com (where I help moderate), there are many questions about QA certifications as an aid to gaining employment.


Now, I want be right up front here. I don’t own a certification. I’ve never mentioned certification in any job description I’ve written. And I've never hired anyone based on a certification.

I’ve known some great QAers who had one or more certifications, but I’ve known many more equally great QAers who were not certified.

Still, I wondered if perhaps employers were now starting to require some sort of certification in their hiring practices, so I decided to check.

Monster.com is perhaps the leading online career network. And the CSTE and CSQA are two of the most popular QA certifications – administered by the Quality Assurance Institute.

So I decided to see how often CSTE and CSQA were required in jobs posted on Monster.

I went to Monster.com and searched for “Software QA”. I got 4458 results.

When I searched for “Software QA CSTE”, I got 32 results (a bit over 0.7%)

Of those 32:
  • 4 indicated that certification was required.
  • 24 indicated that certification was “desired, a plus, nice to have, preferred, etc”.
  • 1 indicated that it was “experience with the Body of Knowledge” for this certification that was desired.
  • 3 had the phrase in a hidden keyword. Basically they used a white font on a white background. So it wasn’t actually mentioned in the job description at all, and certainly wasn't required, but candidates searching using the word CSTE would find the job.
When I searched for “Software QA CSQA”, I got 26 results (a bit less than 0.6%)

Most of those 26 were the same jobs returned when searching for CSTE:
  • None indicated that certification was required.
  • 24 indicated that certification was “desired, a plus, nice to have, preferred, etc”.
  • 1 indicated that it was “experience with the Body of Knowledge” for this certification that was desired.
  • 1 had the phrase in a hidden keyword.
So will having a CSTE or CSQA help you get hired? Perhaps. But it probably won't matter. I guess it couldn't hurt.

March 29, 2007

Perhaps They Should Have Tested More - US Airways



  • A major, complex system conversion... performed during a "peak time".

  • Over 21% of the records "didn't sync up".

  • It was "akin to doing both a brain surgery and a heart transplant at the same time, while throwing in a little plastic surgery for good measure"







  • US Airways partly blames legacy systems for March glitchLinda Rosencrance

    March 29, 2007 (Computerworld) Reliable, yet inflexible legacy systems were partly to blame for the glitch in US Airways Group Inc.'s self-serve kiosk system that led to long lines and delayed flights earlier this month, according to an e-mail sent to the airline's frequent fliers by a company executive.

    The glitch was tied to the integration of reservation systems with America West Airlines. US Airways was using a system by Sabre Airline Solutions, while America West was using Electronic Data Systems Corp.'s Shared Airline Reservations System (SHARES). The two airlines, which merged in 2005, are now operating on the SHARES system.

    "When we transferred the 7 million reservations from one system to the other, approximately 1.5 million of them didn't 'sync up' correctly, and our agents had to hand-process each reservation," said H. Travis Christ, the airline's vice president, sales and marketing, in the e-mail. "Many systems that were otherwise ready to go became bogged down with these reservations. We've since whittled the number of 'out of sync' reservations to a very small number."

    In a telephone interview, Christ explained that most airline computer systems were built on legacy mainframe systems from the 1960s and 1970s. These systems are deeply embedded with everything like reservations, flight operations, airport operations and accounting.

    "They are very reliable, but very inflexible. As our business changes, it's as though we're fighting with one hand tied behind our back," he said in the e-mail to customers.

    In the interview, Christ said these legacy systems were revolutionary at the time they were built, and they helped the airlines to move away from keeping reservations on 3x5 note cards. Then came air-travel software systems like Sabre, which coincided with the deregulation of the airline industry and the rapid growth of the business, Christ said.

    But as more modern Web-based systems were introduced and the level of expectations of the technology changed from a business to a customer perspective, it became clear these legacy systems were nearing the end of their useful lives, he said.

    US Airways CIO Joe Beery said there's nothing wrong with mainframes, but rather the concepts behind the architecture of the systems. Beery said the legacy systems were developed based on the premise that airlines used paper tickets. However, now that airlines use electronic tickets, those systems are outdated.

    So the problem, Beery said, is that when it's time to make changes in the legacy systems or when there's a merger, IT has to continually rebuild those concepts.

    "So it's the framework and how the architecture of the systems are built that really hold us back," he said. "There really isn't any [modern system] operating in the industry, at least for major carriers, that you would consider a modern architecture."

    Both Christ and Beery acknowledged that ultimately US Airways will have to move to a more modern system, but they also know that system doesn't exist yet.

    Airline analysts agreed that the airlines are facing an uphill battle in trying to adapt technology to the changing airline industry.

    "There are two issues here. One issue is migration from one to another, which was problematic. The other issue is the functionality of legacy systems versus new generation systems," said airlines' analyst Bob Mann, president of R.W. Mann & Co. in Port Washington, N.Y.

    "I've done this on numerous occasions as a consultant in numerous places around the world, and I've never had a screw up like that so I'm not sure why that happened," Mann said.

    Mann added there is no new system that can handle all the functions needed by the airlines.

    "They'd like to be on new generation systems so they can check revenue production moment by moment, but no new generation system can handle all the requirements that a legacy airline has," Mann said. "We're talking years, not months, for a new generation system to be developed. If one existed, everyone would be standing in line for it."

    Henry Harteveldt, an analyst at Cambridge, Mass.-based Forrester Research Inc., said reservation system conversions are never as easy as people think they'll be. But US Airways took every step it possibly could have from a technology standpoint to address the challenge.

    "But I don't think they understood all the implications, and they really failed by not having enough staff at key legacy US Airways hubs to help agents," Harteveldt said. "And I do believe that US Airways may have underestimated some aspects of the complexity of the migration, and in addition it came at a peak time -- spring break travel season."

    Harteveldt said US Airways made its decision based on cost and the belief that it would be less inconvenient to disrupt America West than to disrupt US Airways.

    "It's wrong to blame legacy systems -- it's disingenuous -- it's like they did eeney, meeny miney, moe [looking for something to blame]," he said. "A business person reading this would have said, 'Why didn't you just wait six months or a year.'"

    Harteveldt said when US Airways migrated its reservation system, it was akin to doing both a brain surgery and a heart transplant at the same time, while throwing in a little plastic surgery for good measure.

    Harteveldt said legacy systems are not as flexible as airlines would like, but both the Sabre and the SHARES systems have been modernized to some degree to make better use of service-oriented architecture and Web services to reduce their reliance on closed-end languages and to make the systems more flexible.

    "It's very popular within the industry to blame legacy IT systems, and to an extent [Christ's] certainly right, but there have been transitions that have been successful and those don't get a lot of publicity," said Douglas Quinby, an analyst at PhoCusWright Inc. in Sherman, Conn.

    Beery said there will come a time when [all the airlines] will have to make a decision to move on to modern systems.

    "Legacy systems are not going to go away tomorrow, but we can't continue to operate forever using technology that was developed in, and ties us to, the 1970s," Christ said.

    (http://www.computerworld.com/action/article.do?command=viewArticleBasic&taxonomyName=enterprise_applications&articleId=9015078&taxonomyId=87&intsrc=kc_top)

    Perhaps They Should Have Tested More - Yahoo!


    • Some users "automatically unsubscribed from their own groups by Yahoo's anti-flood-detection software"
    • up to 25 duplicates for each original message


    Yahoo Groups hit by massive duplicate e-mail bug
    March 29, 2007 9:02 AM PDT

    A major bug in Yahoo's mailing list software has deluged in-boxes around the world with duplicate messages.

    Yahoo Groups confirmed the glitch in a brief statement on Wednesday evening.
    CNET News.com reader David H. reported in e-mail that the problems started early on Wednesday. He said: "What is incredible to me is that 17 hours later, Yahoo has neither solved the problem nor rolled back their 'upgrade' -- despite hundreds of messages from irritated group managers, some of whom have been automatically unsubscribed from their own groups by Yahoo's anti-flood-detection software."

    Comments posted on Yahoo's official blog said that messages often were arriving faster than users could delete them, with up to 25 duplicates arriving for each original message. Some mailing list operators responded by enabling emergency moderation, and others reported additional glitches such as messages not appearing that should have. Over 1,500 comments were posted.

    In a revised statement released at 8 a.m. on Thursday, Yahoo said: "A fix was pushed at midnight (PT) that we believe has resolved the problem for messages submitted after that time. However, it is possible that some users of some groups may have continued to receive duplicates of messages that were posted before midnight."

    It was not immediately clear whether the glitch was due to Yahoo announcing earlier in the day on Wednesday that it would open its e-mail interface to outside software developers.
    Posted by Declan McCullagh

    (http://news.com.com/2061-10811_3-6171648.html)

    March 28, 2007

    Sample Job Descriptions for QA Engineering Positions

      Sample Job Descriptions
    Quality Assurance Engineer
    The QA Engineer works with Developers, Product Managers, Project Managers and others to help ensure high quality and timely delivery on multiple implementation projects of varying sizes and complexities.  The QA Engineer plans and executes manual and automated testing throughout the development cycle and during periodic releases.  Throughout the project, the QA Engineer communicates frequently with team members regarding quality status, and helps to resolve project problems and issues to ensure the highest degree of customer satisfaction.

    Essential Duties/Tasks:

    • Develop and execute testing strategies and plans for various products and projects
    • Work with developers and support personnel to identify and correct defects
    • Utilize various testing tools as appropriate, in order to automate the execution of test cases
    • Write and track Bug Reports as problems are found and corrected
    • Participate in periodic release activities
    • Work with Engineering team to brainstorm and test new ideas
    • Investigate and assess emerging web and software technologies

    Knowledge of Industry, Product, and Technology:

    • 2-4 years QA experience in a commercial software environment
    • Experience in the financial services sector a plus
    • Experience in testing web applications
    • Experience in testing database applications, particularly those using Oracle or SQL Server
    • Experience with XML and AJAX a plus

    Education and other Qualifications

    • Bachelors degree in computer science, information technology, engineering, or related field
    • Analytical and problem-solving skills
    • Time management skills
    • Articulate oral and written communication skills
    • Team player
    • Good interpersonal skills




    Senior Quality Assurance Engineer
    The Senior QA Engineer works with Developers, Product Managers, Project Managers and others to help ensure high quality and timely delivery on multiple implementation projects of varying sizes and complexities.  The Senior QA Engineer plans, schedules and executes manual and automated testing throughout the development cycle and during periodic releases.  Throughout the project, the Senior QA Engineer communicates frequently with team members regarding quality status, and helps to resolve project problems and issues to ensure the highest degree of customer satisfaction.  The Senior QA Engineer will have broad experience in many aspects of software quality, and expertise in some.  The successful candidates will have a passion for quality, and the drive to accomplish their goals.

    Essential Duties/Tasks:

    • Assist in scoping, planning and scheduling QA activities for various projects
    • Develop and execute testing strategies and plans for multiple products and projects
    • Assist the Development team in assessing and improving testability of the system
    • Work with developers and support personnel to identify and correct defects
    • Utilize various functional and load testing tools as appropriate, in order to automate the execution of complex test cases
    • Write and track Bug Reports as problems are found and corrected
    • Participate in periodic release activities
    • Provide QA expertise for more junior members of the QA team
    • Work with Engineering team to brainstorm and test new ideas
    • Investigate and assess emerging web and software technologies

    Knowledge of Industry, Product, and Technology:

    • 5-8 years QA experience in a fast-paced, commercial software environment emphasizing Windows
    • Experience in the financial services sector a plus
    • Experience in manual and automated testing of web applications
    • Experience in load/performance testing
    • Experience in testing database applications, particularly those using Oracle or SQL Server
    • Experience with XML, XSL, web services or AJAX a plus

    Education and other Qualifications

    • Bachelors degree in computer science, information technology, engineering, or related field
    • Excellent analytical and problem-solving skills
    • Strong time management skills
    • Excellent oral and written communication skills
    • Ability to work independently as well as contribute in a team environment
    • Strong interpersonal skills

    March 24, 2007

    Palm Trees in the Outfield!

    We vacationed in Florida last week and while we were there, we took in a Red Sox Spring Training game.

    I have to say it was a lot of fun!

    I'm not a big baseball fan, and only get to a few games at Fenway Park. But it was a bit odd seeing the palm trees as a backdrop to the ball field.



    I hadn't realized that the games would all be sold out, so I was only able to buy standing room only tickets. It turned out to be a really good idea anyway.

    Where we stood against a wall along left field we were very close to the players ("Hey Manny!") and could still turn around and watch as some of the players left after the third inning to go to their cars and drive home ("Hey Coco, up here!").

    So we got to see lots of the Red Sox of the present, a few Red Sox of the past (we saw Louis Tiant), and some Red Sox players of the future.

    We also saw a minor celebrity. As we were getting to our spot in left field, we walked by a woman. My son said "Do you know who that is?" Turns out her name is Jessamy Finet and she was one of the extras in the movie Fever Pitch.

    We enjoyed the game, the weather, the beaches, the pool. Nice vacation!

    March 22, 2007

    Links for Major Test Automation Vendors



    If you are interested in learning more about or downloading trials of test automation tools from the major vendors, here's a handy list of links.

    AutomatedQA (TestComplete)

    Borland (SilkTest, SilkPerformer, SilkCentral)
    Compuware (TestPartner, QARun, QALoad, QADirector)
    Empirix (e-Tester, e-Load, e-Manager)
    HP Mercury (WinRunner, QuickTest Pro, LoadRunner, Quality Center, TestDirector)
    IBM Rational (Robot, Rational Functional Tester, Rational Performance Tester, TestManager)
    RadView (webFT, WebLoad, WebLoad Open Source)
    Redstone Software (Eggplant)
    Seapine Software (QA Wizard, TestTrack)

    March 7, 2007

    Perhaps They Should Have Tested More - Lockheed Martin Corp.

    A squadron of new F-22 aircraft go "deaf, dumb, and blind" as "all systems dump" while crossing the International Date Line (see: http://transcripts.cnn.com/TRANSCRIPTS/0702/24/tww.01.html) .

    A Year 2000-like or Daylight Saving Time-like bug?
    An unrelated glitch in the millions of lines of code in this system?

    It's not (yet) clear.





    Jet launch highlights problems

    Experts say the F-22s' navigation issue is an embarrassment for contractors.
    Richard Burnett and Chris Cobbs | Sentinel Staff Writers
    Posted March 5, 2007

    The Air Force recently showcased its newest fighter jet, the F-22 Raptor, with a group flight over the Pacific Ocean, but some analysts say a technical glitch that tainted the flight was a wake-up call for the defense industry.

    A half-dozen F-22s were flying from Hawaii to Japan last month when their navigation computers malfunctioned as they crossed the International Date Line.

    Unable to correct the problem during the flight, the group flew back to Hawaii, where it took two days of troubleshooting before the glitch was fixed. Lockheed Martin Corp., the F-22's prime contractor, coordinated the effort. Eventually, the Raptor group made it safely to Okinawa.

    Lockheed and the Air Force say that there was no major problem with the F-22. Glitches often occur with new electronic systems, they said, and the F-22's other equipment performed flawlessly.

    Still, the disruption had to be an embarrassment for the contractors and the Air Force, some aerospace experts said.

    The flight to Japan was supposed to "show off" the F-22 and convince the Japanese that "it is just what they needed to fend off communist Red China" in some potential future conflict, said John Pike, president of GlobalSecurity.org, a defense-research firm in Washington, D.C.

    "I think the Japanese will ultimately be persuaded of that," he said, "but this incident did not assist the U.S. in making its case."

    The F-22's high-profile glitch was a cautionary tale for the aviation industry, other experts said. It should motivate engineers to do more advance testing of sophisticated flight software to avoid such errors in the future, they said.

    "Is this a wake-up call? Yes, absolutely," said Andrew Kornecki, an engineering professor at Embry-Riddle Aeronautical University and an expert on navigation software. "People in the industry are already exchanging information about that situation."

    It's still not clear exactly what happened to the F-22's navigation system, which uses Global Positioning System satellites to guide them through the air.

    Some outside experts have speculated the system's software did not properly handle the change at the International Date Line -- a notion Lockheed disputes. Company officials say it was coincidental that the glitch occurred when the aircraft crossed the date line.

    Whatever the cause, it would be helpful if Lockheed would share it with the broader aviation-engineering community, so others could benefit, Kornecki said. But he acknowledged that may not happen because of Lockheed's competitive concerns or the military's security issues.

    "The problem may have involved the International Date Line or it may be some other glitch that they don't want to tell the public about," Kornecki said. "It is obviously a very closely guarded situation."

    http://www.orlandosentinel.com/technology/orl-tech0507mar05,0,185282,print.story?coll=orl-technology-headlines