×

Discussion Board

Results 1 to 8 of 8
  1. #1
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Ovi QA testers seem to think they dictate the app functionality...

    One of our apps has recently failed the Ovi QA for a reason we have yet to fully understand.

    It appears that an Ovi QA tester has decided that one of our apps should have a bit of functionality that is not currently included in the app. As the application publisher and people that have to support the product we did not feel there was a need to incorporate the indicated functionality nor that the functionality affected the performaance of the application or the ability of customers to use the application.

    i) this happens to be an upgrade to a previous version of an app already accepted in Ovi store with no change at the functional level.
    ii) another of our apps with the same sort of functionality was accepted the previous day by Ovi testers - or more precisely an app with the same so called 'missing' functionality is 'missing' because its not required to be in the apps.
    iii) the app conforms to all the Symbian Signed test criteria - although this version is Epxress Signed, previous versions were 'old' Certified Signed - as far as we are aware.
    iv) we have downloaded a number of other publishers apps from Ovi Store and these do not contain the functionality we appear to be failed on.


    So
    i) Why are Ovi QA attempting to dictate application functionality ?
    ii) How have Ovi QA obtained our application 'functional specification' (we have not sent one as far as we are aware) + can they tell us where in that document they have located the requirement to have the 'missing' functionality becase we are unable to locate it in our version of the doc.
    iii) there does not appear to be any consistency here, either between versions of 1 app, different apps from same publisher or different apps from different publishers, which makes it doubly difficult to understand what is required/not required.

    Whilst we fully understand the need to maintain a sensible level of QA surely the QA here is really all about ensuring the apps actually work on devices claimed + whether they conform to the ethical requirements of individual territories not wehther apps contain functionality that it appears a particular tester would like to see.

  2. #2
    Registered User
    Join Date
    Apr 2008
    Posts
    20

    Re: Ovi QA testers seem to think they dictate the app functionality...

    As a publisher, it would be interesting to know what is this feature they suddenly require. You could save other publisher time and money revealing the feature that is being dictated.

  3. #3
    Regular Contributor
    Join Date
    Feb 2006
    Location
    Los Angeles
    Posts
    217

    Re: Ovi QA testers seem to think they dictate the app functionality...

    Quote Originally Posted by aol View Post
    As a publisher, it would be interesting to know what is this feature they suddenly require. You could save other publisher time and money revealing the feature that is being dictated.
    I second that, if you don't mind saying what it was.

  4. #4
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Ovi QA testers seem to think they dictate the app functionality...

    Hi all

    We delayed anwering in the hope that the Ovi QA people would be considerate enough to get back to us with the requested clarification on the issue, however since they appear to be unable to do so below is the failure report.

    Before reading you may wish to note
    i) We dont have anything called 'Instructions' in the main menu so not sure what thats all about.
    ii) It appears its mandatory to have EXIT HELP and ABOUT in a menu. The app in question has Exit and About. Exit is on the right softkey button as is standard for S60 apps, About is in the menu + displays information sufficient to pass the Symbian Signed test criteria on version information. Exit will quit the application + return to the app manager/launcher.

    As a matter of company policy we dont include online help in apps but via Users manuals. The rationale for this is i) if the app is not intuitive enough to use without any help its unlikely any online help (mainly text) is going to help enough, ii) many apps (builds of apps) cant integrate with the Symbian help system as the v9 security model has broken standard online help (yes apps in Ovi are now signed + use UIDs such that online help would work in this build but...) iii) Implementing our own help logically means you need to have some form of Help on how to use the app specific Help...(sic) and iv) practically all online help on a mobile involves moving away from the screen that you are attempting to use + need help on. All contextual information gets lost and the help becomes next to useless.
    (Also dont forget Ovi Store requires you to provide a user guide anyway...)

    For example have you actually read say the help text with say the Calculator on a 5800: "Enter the first number of the calculation", "Select a function. Calculations are made in the order in which you enter them." "Enter the next number of the calculation"

    Maybe I have a brain the size of a planet but the above is completely pointless... Surely I would enter all calculations in Reverse Polish as thats the natural thing to do...I think NOT... and calculations would be made is a totally random order etc.

    So anyway below is the failure report. If you can shed any light on its true meaning it would be appreciated.

    Comments from the QA team:
    Failed Case 1: User Interface
    Summary: If the user selects the "Instructions" option from the main menu, then the user notices that the content in the Instructions option are not displayed.
    Requirement: Contents that feature Main Menus must have the availability of EXIT, HELP, and ABOUT.
    Steps to conduct the test:
    1. Launch content.
    2. Proceed to the Main Menu.
    3. Observe that the Main Menu features the following categories:
    - About
    - Help
    - Exit.
    4. Enter each category and observe that the functionality of each categories function and displays some sort of descriptions for the user.
    Expected Results:
    - The categories is seen and accessible.
    - HELP & ABOUT displays clear descriptions for the user.
    - Selecting EXIT will exit the user to the application manager..

  5. #5
    Super Contributor
    Join Date
    Jun 2003
    Location
    Cheshire, UK
    Posts
    7,395

    Re: Ovi QA testers seem to think they dictate the app functionality...

    That's an interesting insight into Ovi QA... The test you appear to have failed is:

    The main functionalities of Exit, Help and About are easily available through the main menu
    That's requirement FN11 from Java Verified (UTC 3.0).

    Have Nokia created some super-set of tests, such that Symbian apps must pass JV (and presumably Java apps must pass SymbianSigned??)??

    Graham.

  6. #6
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Ovi QA testers seem to think they dictate the app functionality...

    Afraid we cant really tell what Nokias thinking is at this stage - we are currently unable to obtain a response from their QA + the PublisherSupport people are also still awaiting a response from their QA with no indication of when information may be forthcoming.

    Its entirely possible that Java test criteria are being applied to Symbian native apps (and vice versa), after all most are reasonable + fairly abstract demands (apps should not crash etc) but no-one has mentioned this anywhere that we have seen.

    Perhaps one conseqence of most of the Java Verified testing being abandoned is the testers have got bored and decided to apply the test criteria to non Java apps....;-)

    John

  7. #7
    Super Contributor
    Join Date
    Jun 2003
    Location
    Cheshire, UK
    Posts
    7,395

    Re: Ovi QA testers seem to think they dictate the app functionality...

    Of course, it is entirely possible that the tester simply ran the wrong tests.

    You might consider bumping the version number, and resubmitting it.

    Graham.

  8. #8
    Regular Contributor
    Join Date
    Jun 2004
    Posts
    56

    Re: Ovi QA testers seem to think they dictate the app functionality...

    Weve already done that and are awaiting the result as weve got bored waiting for QA to get around to providing any clarification.

Similar Threads

  1. Ovi Testing
    By grahamhughes in forum [Closed] Publishing to Nokia Store
    Replies: 8
    Last Post: 2009-05-09, 15:41
  2. Replies: 13
    Last Post: 2007-02-12, 03:43
  3. Dialog's clipping area (again). Nokia experts, please help
    By synov in forum Symbian User Interface
    Replies: 0
    Last Post: 2004-06-26, 14:35
  4. Pre Public Beta testers for UK LBS app...
    By drstarcat in forum Mobile Java General
    Replies: 0
    Last Post: 2003-11-01, 23:05
  5. Launching an app from pJava..
    By krajag in forum PersonalJava
    Replies: 0
    Last Post: 2002-10-10, 19:57

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
×