Can all registered uses please login, even just for a few minutes..
It helps build a picture where our "good traffic" is coming from..
Thanks :)

GEMBench ripped by AI now?

This chat forum will appear to guests and bots. IE will appear on search engines etc. If you do not want your appearing publicly then please use the original chat forum.
Post Reply
User avatar
exxos
Site Admin
Site Admin
Posts: 29650
Joined: Wed Aug 16, 2017 11:19 pm
Location: UK
Contact:

GEMBench ripped by AI now?

Post by exxos »

I'd be interested in what people think about this one.

This Reddit thread was sent to me earlier, for reference: Just a little tease of just how fast our native "ST" is...

A bit of background first. GEMBench 4 was written by its original author, Ofir Gal, who later handed the whole project over to me, source code and everything. I rebuilt it into GB6, which is still maintained, and GB7 is slowly in development. So this isn't an abandoned project, it's still very much alive, even if it moves at the speed of a 1772 seeking track 79.

Going by the video in that thread, "STBench" has clearly taken the GEMBench test routines and the RSC file and put them out under a new name. Nobody asked me about it, and renaming it doesn't really change where it came from. I think it's a bit much to rip anything with AI like this.

To be fair, it might be a bit of pot calling the kettle black, as I'm currently enhancing Super Cars II myself. The difference I see is that the game has been unsupported for over 30 years and nobody is ever going to release an update for it, whereas GEMBench is still actively maintained.

So where do people draw the line? Is it fair game to rip code and resources from software that is still actively maintained, or should you at least ask first?

I'm also a bit confused by the claim that 4.03 had to be used because it was the last version to work with TOS 1.00. I've just run GB6 under TOS 1.00 in Hatari on a stock ST in medium res, and it loads and completes the full test run without any problems.

GB6TOS100.png
GB6TOS100.png (28.32 KiB) Viewed 174 times

On the subject of crashes in general, GB6 works the hardware pretty hard, so when it does crash it tends to point to a hardware fault rather than a problem with GB6 itself.
ijor
Posts: 858
Joined: Fri Nov 30, 2018 8:45 pm

Re: GEMBench ripped by AI now?

Post by ijor »

My very personal opinion, is that ripping code from somebody else without asking the original author, is the wrong thing to do, regardless if the software is still being maintained or not. At the very least you should always ask first, and you should certainly always give credit.

Reading the thread, he claims he didn't actually copy the code?:
I'm not copying his code, just trying to create a fair comparison, doing the same tests.
To be honest, this doesn't make much of a difference for me. It might be drastically different from the legal point of view. But ethically, IMHO, if you copied an idea or a concept, even when you evolved the idea an enhanced the code, you should still give enough credit.
http://github.com/ijor/fx68k 68000 cycle exact FPGA core
FX CAST Cycle Accurate Atari ST core
http://pasti.fxatari.com
User avatar
exxos
Site Admin
Site Admin
Posts: 29650
Joined: Wed Aug 16, 2017 11:19 pm
Location: UK
Contact:

Re: GEMBench ripped by AI now?

Post by exxos »

Thanks ijor, I agree, asking first and giving credit is really the least anyone should do. Ofir passed GEMBench on to me, but he is still credited for the original, and that is how it should be.

Fair point too that by that measure it applies to my Super Cars II work as well. The original game will always be credited to Magnetic Fields and Gremlin, and anything I release will be an enhancement to the original, not passed off as my own game.

As for "not copying the code", the video shows the same tests, in the same order, using the original RSC and exactly the same test text. It even shows the HGT dialog at the end. HGT is the HiSoft GEM Toolkit, a HiSoft BASIC add-on, and both GB4 and GB6 were written in HiSoft BASIC. That dialog doesn't turn up in a program written from scratch by accident. If you swap the badge on a Ford Escort, it's still an Escort underneath.
User avatar
Darklord
Site sponsor
Site sponsor
Posts: 1697
Joined: Wed Sep 20, 2017 1:41 pm
Location: Prestonsburg
Contact:

Re: GEMBench ripped by AI now?

Post by Darklord »

Well, I think it's rude, at the very least. :roll:
Welcome To DarkForce! www.darkforce.org "The Fuji Lives.!"
Atari SW/HW based BBS-Telnet:darkforce-bbs.dyndns.org 1040
User avatar
exxos
Site Admin
Site Admin
Posts: 29650
Joined: Wed Aug 16, 2017 11:19 pm
Location: UK
Contact:

Re: GEMBench ripped by AI now?

Post by exxos »

Darklord wrote: Sun Nov 01, 2026 8:22 am Well, I think it's rude, at the very least. :roll:
Yep. Can clearly see that things thing the blitter tests are identical with identical shapes tested and other tests as well. Its basically GB4 with the GUI ripped out.
User avatar
Badwolf
Site sponsor
Site sponsor
Posts: 3166
Joined: Tue Nov 19, 2019 12:09 pm

Re: GEMBench ripped by AI now?

Post by Badwolf »

Is he labouring under the misapprehension that GB4 was the end of the line and is abandoned?

ie. Is he perhaps unaware of GB6?

BW
DFB1 Open source 50MHz 030 and TT-RAM accelerator for the Falcon
Smalliermouse ST-optimised USB mouse adapter based on SmallyMouse2
FrontBench The Frontier: Elite 2 intro as a benchmark
User avatar
Darklord
Site sponsor
Site sponsor
Posts: 1697
Joined: Wed Sep 20, 2017 1:41 pm
Location: Prestonsburg
Contact:

Re: GEMBench ripped by AI now?

Post by Darklord »

It was mentioned to him... :)

Capture.JPG
Capture.JPG (95.24 KiB) Viewed 30 times
Welcome To DarkForce! www.darkforce.org "The Fuji Lives.!"
Atari SW/HW based BBS-Telnet:darkforce-bbs.dyndns.org 1040
User avatar
stween
Site sponsor
Site sponsor
Posts: 286
Joined: Sat Sep 08, 2018 3:10 pm
Location: Brooklyn & Edinburgh

Re: GEMBench ripped by AI now?

Post by stween »

In the general sense, what I find tiring is how rapidly things can be shoveled out of AI just for the karma. I see it a bunch on reddit, with so many posts about ports of existing games or whatever, which is fueled by a few claude prompts.

I'm not opposed to AI for this type of thing in general: I've used it, I've played around with writing some things for the ST using claude. I'm absolutely okay with it provided the human is engaging in some critical thought around what they're trying to achieve, and not churning something out to abandon it 15 minutes later.

A part of that whole picture is the sense of community, or perhaps the lack of, when somebody can knock something out after a few prompts with an LLM. So the very anti-social aspect here is that somebody can pop up and rattle off a gembench without first engaging with the people who know more about it and its history. I think it's weird when people gatecrash a community and expect to be liked for it.

I don't know who u/Famous-Ebb3041 is or if they tried to engage, before or after. I just find all these context-less reddit posts kind of tiring.

I also don't know how to make things better, other than culturally try to encourage people with their AI-written tools to link back into the community and refer back to original works. Make clear the lineage, what was written by AI, and why, and where the original lives. I think that can only help when people find their repos or binaries in the future.
User avatar
Darklord
Site sponsor
Site sponsor
Posts: 1697
Joined: Wed Sep 20, 2017 1:41 pm
Location: Prestonsburg
Contact:

Re: GEMBench ripped by AI now?

Post by Darklord »

I was hoping for something better when it was pointed out to him.

My original thought was that perhaps the OP just didn't know that
it was still supported, developer was still around, etc, but then
you read his response. <shrugs>
Welcome To DarkForce! www.darkforce.org "The Fuji Lives.!"
Atari SW/HW based BBS-Telnet:darkforce-bbs.dyndns.org 1040
Post Reply

Return to “CHAT FORUM PUBLIC”