Correct method to report deceptive test results

Post issues, bugs, and feature requests about the various WineHQ websites to this forum.
Locked
crazyviking
Level 1
Level 1
Posts: 5
Joined: Mon Nov 16, 2015 1:08 am

Correct method to report deceptive test results

Post by crazyviking » Mon Mar 19, 2018 3:38 pm

What is the correct method to report intentionally deceptive test results such as neglecting to disclose use of wine wrappers or wrong wine version info but still made it past whomever the app's maintainer was? The reason I ask is because I was browsing through an app's past test results and found an entry where the tester claims to have used Play on Linux to test even though third party wrappers for wine are barred from submitting test data on the test result guidelines wiki page.

User avatar
dimesio
Moderator
Moderator
Posts: 12677
Joined: Tue Mar 25, 2008 10:30 pm

Re: Correct method to report deceptive test results

Post by dimesio » Mon Mar 19, 2018 6:26 pm

Report it here. Post a link to it.

crazyviking
Level 1
Level 1
Posts: 5
Joined: Mon Nov 16, 2015 1:08 am

Re: Correct method to report deceptive test results

Post by crazyviking » Tue Mar 20, 2018 6:56 pm

Here's the thread from another site where they speak about it: 1 2 3

He appears to have the same username "BloodyIron" on the AppDB as in that link, he had a submission in the fallout 4 that mentioned he used PoL here.

User avatar
dimesio
Moderator
Moderator
Posts: 12677
Joined: Tue Mar 25, 2008 10:30 pm

Re: Correct method to report deceptive test results

Post by dimesio » Tue Mar 20, 2018 10:32 pm

Thank you for reporting it. I've deleted that test report and warned the entry's maintainers that they should pay closer attention to the content of test reports when processing them. Not only did he mention using POL, he also said he had really used a different Wine version than the one he selected from the dropdown list. It never should have been accepted.

User avatar
Bob Wya
Level 12
Level 12
Posts: 2768
Joined: Sat Oct 16, 2010 7:40 pm
Location: Cambridge
Contact:

Re: Correct method to report deceptive test results

Post by Bob Wya » Thu Apr 05, 2018 4:27 pm

dimesio wrote:Thank you for reporting it. I've deleted that test report and warned the entry's maintainers that they should pay closer attention to the content of test reports when processing them. Not only did he mention using POL, he also said he had really used a different Wine version than the one he selected from the dropdown list. It never should have been accepted.
@dimesio

Steve Ebey (maintainer) has actually self-posted a submission for World of Warcraft that is:
Wine 3.5 staging with PBA. Compiled with no debug symbols. Used PBA from Goldpaw repo.
...
Platinum
Surely this guy should know that the PBA patchset is totally unofficial?
Should we be kicking maintainers if they do this?
Or just warn them?

It's really annoying - because WOW players tend not to be the most "technically literate" of Wine users...
Leading to unrealistic expectations of what vanilla Wine can do... :roll:

Bob

User avatar
dimesio
Moderator
Moderator
Posts: 12677
Joined: Tue Mar 25, 2008 10:30 pm

Re: Correct method to report deceptive test results

Post by dimesio » Thu Apr 05, 2018 9:22 pm

Bob Wya wrote: Surely this guy should know that the PBA patchset is totally unofficial?
Should we be kicking maintainers if they do this?
Or just warn them?
The first time, delete the test report and warn them. If they do it again, remove them as maintainers.

Locked