×

Discussion Board

Results 1 to 9 of 9
  1. #1
    Regular Contributor
    Join Date
    Feb 2006
    Location
    Los Angeles
    Posts
    217

    Lightbulb Publishers helping Nokia to streamline QA process

    It seems like everyone is in the same boat with QA approval process time. I think there are some things that Nokia could ask developers/publishers to do to help reduce the amount of QA work.

    Please add other suggestions if you have any. Some thoughts:


    Content Rating
    --------------
    It appears that QA staff are asked to look for occurrences of elements not allowed in certain countries. Could OVI simply ask developers to check a box if anything on a list is contained in the content? This would also need to tell the developer which countries to deselect.


    Passive Content:
    ---------------
    If not automated, would it help for developers to be able to identify their file as passive content?


    Superset of supported phones
    ----------------------------
    It seems currently that an app fails QA if it supports more devices than OVI supports, but it only fails once it reaches a QA person. Would it be possible for Nokia to ONLY list OVI supported devices in the support matrix? Or, should developers specifically ONLY list devices in the document "OVI Store Supported Devices" on https://publish.ovi.com/help/content_providers? Is this future-proof?


    QA process details
    ------------------
    Could Nokia publish a QA process detail or their QA checklist? Perhaps this could help us publishers come up with more ways we could help Nokia with the QA process, and also help us to make sure everything is in order for QA.

  2. #2
    Registered User
    Join Date
    Jun 2009
    Posts
    4

    Post Re: Publishers helping Nokia to streamline QA process

    Hi,

    I think this is a very good initiative.

    I would like to add:


    Differentiate between QA approval for meta-data and QA approval for builds
    --------------------------------------------------------

    It appears, from our own experience, that attempting to update the Icon/ Promotional Images without updating or replacing the builds in any way, still causes the builds to go through the review process again. The same builds already approved and published! (exact same files that were uploaded the first time).
    QA people should instead check exactly what files have been replaced since the last approval/ item lock/unlock and only review those. Alternatively an automated system could be implemented that would help testers with this by highlighting the changed files.

    This would be a huge time-saver for QA personnel, especially considering they are allegedly swamped with work right now.

  3. #3
    Registered User
    Join Date
    May 2009
    Posts
    7

    Re: Publishers helping Nokia to streamline QA process

    I think this is a great initiative too - especially the QA process details. Some of us may be getting the idea by now but I'm sure it would be extremely helpful for new developers.

  4. #4
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Publishers helping Nokia to streamline QA process

    I second/third/fourth or whereever I am in the list this.

    QA also need to be a bit more precise on what items have failed and where.
    For example we have 2 apps that have failed due to something within the following:

    "Please modify the distribution for this content item since preview images and content items containing references to controversial subjects such as alcohol, tobacco, drugs, gambling, betting or casinos (poker, dice & card games etc.), religion, interaction between different sexes (flirting, kissing, hugging, touching), references to sexuality in general or images of females/males wearing skimpy clothing (bikinis, swimming suits, tight dresses, t-shirts, shorts etc.) won’t be published in sensitive countries such as..."


    All it needs is for
    i) an indication of which of the above and
    ii) where in the apps or meta data the issue exists

    in the failure report so we can either correct the issue or adjust distribution data. By definition this information is available to QA since they have failed the app due to noticing one of the above somewhere in the app.

    We also need some kind of sensible 'appeals process'. I.e. a mechanism to determine what would be acceptable to QA rather than simply guessing, re-signing, re-submitting, failing, guessing, re-signing, re-submitting, passing/failing which is the current process.

  5. #5
    Regular Contributor
    Join Date
    Feb 2006
    Location
    Los Angeles
    Posts
    217

    Re: Publishers helping Nokia to streamline QA process

    We had this one two of our submissions, but the failure notice had more details. What we did to get to the next level was deselect the countries listed in the failure notice from the distribution tab and it passed that step the next time around. Here's the thread with the list of countries:

    http://discussion.forum.nokia.com/fo...d.php?t=169732

  6. #6
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Publishers helping Nokia to streamline QA process

    Hi

    Appreciate that deselsecting the countries is one route forwards but that does not really make much sense to us in our case.

    From what we can tell the product has been failed simply because its a card game - but there is no gambling/betting/casino attributes in the game. A different card game with same attributes is apparently ok. Trying to tell us that all card (and dice) games are banned in the listed countries is simply nonsense - if they were presumably all the attendees at the 15th Bridge Federation Asia/Middle East tournament at end of June 2009 to be held in Jordan (banned country) with competitors from a whole host of other banned counties are in for a hard time. e.g. see http://www.bfame.org/

    My main point was that from that list of banned entities it can be pretty hard to know which one you have fallen foul of, where in the app it is and why. For Nokia QA to provide some info on which one of the subjects is a problem and vaguely where in the app would be pretty simple for them.

    If, as appears to be the case to us, the app has been failed incorrectly then some kind of appeals process is required to correct the decision.

    E.g. As far as we can tell the tester has read that any thing in brackets in the test criteria should be globally applied and not applied within the context of the previous statement. Surely the statement "gambling, betting or casinos (poker, dice & card games etc.)," does not mean all card and dice games are banned irrespective but means dice and card games that contain betting or casino type attributes are problematic. If ALL card games are banned perhaps the attendees of the Bridge Tournament above should be warned ?

  7. #7
    (Retired) Nokia Developer Admin.
    Join Date
    Jan 2006
    Location
    Michigan
    Posts
    4,664

    Re: Publishers helping Nokia to streamline QA process

    I don't mean to be hardline but that is the policy. It is applied equally to all submissions.

    Ron

  8. #8
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Publishers helping Nokia to streamline QA process

    Sorry to contradict you Ron but thats simply not the case.

    i) the apps were originally accepted.
    ii) for the upgrade of 3 card games, 1 was accepted and 2 failed within about 1 day of each other. All 3 have same attributes.

    So exactly how is this applying the same criteria 'equally' to all submissions ?

    It still does not really get around the original point of the post which is that it can be pretty hard to know which of the 'contraversial subjects' the app has failed on and where.

    John

  9. #9
    (Retired) Nokia Developer Admin.
    Join Date
    Jan 2006
    Location
    Michigan
    Posts
    4,664

    Re: Publishers helping Nokia to streamline QA process

    Hi John,

    Thanks for explaining it further, I did not read the full thread before responding. I agree my reply was short sigted. I have two meetings with Ovi Store people tomorrow and I'll bring this up. Especially the appeals and identifying the particular version that failed.

    Ron

    Ron

Similar Threads

  1. Nokia N-Series Complete Model Line-Up
    By Dopod in forum General Development Questions
    Replies: 6
    Last Post: 2008-07-22, 20:16

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
×