|Posted by efess on 2019/05/12 12:58:31|
|Hello, my first post here, hope. I normally used to post on quakeone.com, but I think here is a better place for this kind of post?
The original developer seems content with leaving the original source close to original, so I've forked it and have been quietly toying with it off and on the last few years. The last few months I've been really focused on making something that can be consumed by anyone, and that's the state of today.
Why? When I think of trying to get a friend to run quake, I think of having them install quake, maybe install a quake loader, getting a decent key map, maybe adding command line parameters to get the engine working correctly. WebQuake greatly simplifies all this by allowing me to send a simple link to someone and they can be instantly in-game running a demo, custom map, or multiplayer game. Did I mention platform agnostic? It even runs on mobile!
The downsides to WebQuake -
- Slower than native (this is running webgl, but everything filters through the browser's API)
- Browser may limit key configurations - you there's certain key commands that you can't override in a browser like alt+w
- Require an internet connection to run (can be run offline, might have some options here)
What I've added:
Async/IO - the original source used deprecated blocking IO which isn't compatible with other technologies such as IndexedDB
IndexedDB - Local storage to support adding client pak files. This allows the server to not make pak1.pak public, and allows the user to supply it from their local filesystem, "proving" they bought the game.
ES6 modules - allows the game files to be packaged up in modules
What NetQuake.io offers:
Frontend hosting webquake assets with pak0.pak so you can play shareware out of the box
Master server keeping track of server instances
A couple test instances running on my home server
A CTF server running in AWS Ohio
What I want to do:
- Demo Database - Ability to host/play demos
- Custom map lookup (based on quaddicted's database)
- Add more proquake features to the engine
- Make netquake.io "nicer" - it's currently just a prototype
- Move everything to AWS
- Support local mods
Anyway, that's all. I don't know how useful this might be, so putting out there to gauge interest. Would love to keep a project log here maybe?
#6 posted by metlslime
on 2019/05/13 22:35:31
also, if you use opengl, there are a lot of rendering glitches specific to GLQuake and that were fixed in Fitzquake that would be nice to see in here.
#7 posted by efess
on 2019/05/14 03:42:46
Glad to hear there's interest.
The source and CI/CD is all hosted here:
I can make demos a #1 priority. Playing them is no problem, the question I would have is how to source them. I can provide an area for user uploads and maybe source from existing databases, provided I get permission. Would be nice to have video like progress bars too, but that's some engine work.
I'll definitely check this out later, but probably won't understand any WebGL or WebAssembly parts.
#9 posted by efess
on 2019/05/14 14:18:04
Thank you @Johnny Law, fixed the spelling :)
#10 posted by efess
on 2019/05/31 16:04:07
I've made a few small updates such as fixing NAT and allowing native quake clients to connect to webquake servers, even running in AWS containers. To test this, I have the CTF server running in an Ohio datacenter in a docker container. You can connect to this server seemlessly just by using a URL link (assuming you have added a pak1.pak file in www.netquake.io):
This server can also accept connections from native netquake clients that support the proquake nat fixes (I think most modern clients do now)
I've also spent some time trying to doll up quakeone.com, but that's another subject..
Anyway, next I'm working with Spirit to allow loading maps directly from Quaddicted without any setup (other than registered pak1.pak..). This will work like the QuakeInjector app, but will be totally web based.
This work is being done here:
I attempted to compile emscripten for quake, but had difficulty keeping the compiler from eating up all my memory/swap before crashing.
I had another idea of using FTE for the AWS servers and adding the webquake protocol, but that's a lot of work...
This is great news. I sent you an email but thought I'd say congratulations here. The Quaddicted development is especially amazing news. I'm wondering if the system only needs your id1.pak location once?
Also a request for you: could you do another post re: QuakeOne I thought - and many others do as well - that the site was basically dead. Would love more details if indeed the site is not being actively maintained again.
#12 posted by mankrip
on 2019/06/01 05:11:38
Impressive news. Now that there are free replacement assets for most of the registered version data, it should be possible to do stuff like playing usermade gameplay demos directly from the browser.
#13 posted by efess
on 2019/06/01 21:19:23
@mankrip, this would be great, I wonder if the license would require you to replace all shareware assets as well since:
"User-developed/user-modified maps & utilities can only work with the registered version. (Just to be crystal clear on this point: user-developed/user-modified maps & utilities cannot work with the shareware version of Quake.)"
I take "shareware" version to mean the pak0 assets? I'd assume once you have *all* non-copyright assets, you can do whatever you want with the engine.
#14 posted by mankrip
on 2019/06/01 21:52:34
I take "shareware" version to mean the pak0 assets?
Not exactly. Shareware licenses usually requires you to redistribute things as originally packaged, which means that it also includes the original engine. But in practice, id doesn't enforce that, which is why some mobile ports automatically downloads the pak0.pak file alone.
Which means that the pak0.pak is part of the shareware distribution, but isn't the shareware distribution as a whole. Anyway, fair use policies probably covers this case.
I'd assume once you have *all* non-copyright assets, you can do whatever you want with the engine.
#15 posted by Izhido
on 2019/06/01 22:09:29
... how hard would it be to write id about their stance related to the Shareware episode. I mean, whatever their answer is, we should be able to publish it and have it handy as a definitive reference for each and every millionth time somebody asks for it 😂
#16 posted by mankrip
on 2019/06/01 22:43:56
Id as a company will never issue such a statement in the open. But in the past they privately authorized everyone who reached out to them.
In 2000, DCEmulation released Titanium Studios' QuakeDC with the full game. Id Software contacted them requesting that the PAK1.PAK file was removed from it, and saying that distributing that port with the shareware pak0.pak file was fine.
#17 posted by efess
on 2019/06/08 12:58:27
I've pushed the first working version of quaddicted maps. You can select a map from the Singleplayer page and play it without any additional configuration.
I created a maps service which scrapes the frontend and also uses the quake injector XML file for the map listing. This service also serves as a caching/proxy service for quaddicted map downloads. It's currently running in AWS.
The source for this service is here:
I was pretty impressed at being able to download and unzip a zip file in the browser. It performs pretty well, although some maps will not work correctly and will throw engine errors due to requiring custom engine modifications. Also, some maps have dependencies such as quoth or Arcane Dimensions which isn't supported yet as well.
Next on the list is to allow the user to view their downloaded maps/assets and remove them, or add their own from their hard drive. Also need to update the webquake engine to support modern features such as BSP2.
#18 posted by efess
on 2019/06/10 22:50:49
Small update, added rating starts to maps listing, fancy download progress bar, and ability to view/remove downloaded maps in setup.
Next I plan on tackling some engine issues with newer maps. MH posted a guide to adding BSP2 support to engines, so I'll take a look at that, and see if I can figure out other issues.
This Is So Aweome
congrats again! Plase let us know if we can contribute to the cost of AWS. I'd be happy to!
Got a chance to try this today. Something to keep in mind is that the WebQuake engine cannot handle maps that require expanded limits. So keep that in mind when trying Quaddicted loading. I tried a 1997 map and it seemed to work well.
#21 posted by efess
on 2019/06/16 21:51:16
@dumptruck_ds, yup, that's what I'm currently working on.
I was able to implement the enhanced protocol initially used in fitzquake - protocol 666. This allows sending larger data values used by modern maps.
After implementing the protocol and upping the entity limit, I've hit a limit with lightmaps. This engine parses lightmaps packes them into a single large texture to increase performance. This texture isn't big enough for some of the larger maps, and this causes the "Alloc block full" message. I've spent some time naively trying to increase this limit, but failed since it seems like there needs to be alterations in the way the coordinates map to the textures. This will take time understanding how WebGL works and how the texture packing algorithm works to correct this.
Ignoring the above issue, I've run into significant issues with the renderer not rendering certain entities and not rendering whole rooms. I'm afraid debugging this will force me to get my hands dirty with the guts of the engine, which means I'll have to acquire a deeper understanding of WebGL. which I'll have to do if I want to modify the lightmap texture anyway.
#22 posted by Shambler
on 2019/06/20 20:01:16
#23 posted by efess
on 2019/07/16 14:12:45
Just a progress update, nothing big released yet. Still churning along.
I've spent the last month getting my hands dirty in engine code and world rendering guts. I've got a pretty good grasp of how WebGL works (and OpenGL too) and I'm pretty confident in making changes to the engine.
I've been sandboxing this work here: https://gitlab.com/joe.lukacovic/bsp-viewer
I'm using the QuakeSpasm engine as a reference (and in some cases, outright sharing code) since this engine seems to have decent support for modern maps.
I'm in the process of replacing the world/brush rendering code in the original WebQuake with the rendering code from QuakeSpasm and already see performance improvements, as well as the ability to use x number of lightmaps instead of one single large lightmap.
Also, fog was a fairly easy thing to add.
I've also added BSP2 support, which I've merged into Master and is live on netquake.io (but a lot of maps will still hit the current lightmap limit)
Next will be adding modern features as I find the lack of support in maps.. Things like alpha entities and ladders/fences come to mind. Any big things I need to keep in mind?
I was justing thinking about this yesterday - glad you are still cooking along.
I've seen some edgy stuff in DarkPlaces like bump mapping, stain decals where particles hit walls and full dynamic lighting, but I personally consider those to be more on the fluff side of things than anything imperative.
#26 posted by efess
on 2019/08/11 02:00:48
I've replaced the world/brush rendering code and all lightmap rendering with code from quakespasm. This means most modern maps should load and generally work. Still have a few rendering bugs to work out, but it works pretty well.
Support also added for Fog, Fences, transparent entities, transparent water/lava/slime/teleporters.
I've also moved everything to AWS (Amazon Web Services) and off my home machine, so that should speed up downloads and also the multiplayer instances.
Next is fixing the few rendering bugs I introduced, and support for modern skyboxes
This is all great news. Thanks for all your hard work on this.
#28 posted by efess
on 2021/03/07 19:55:47
Been a while...
Made some updates over the past few months
- SSL all the things, including multiplayer
- faster loading, minimize 404 errors
- backend overhaul (only affects me ($$) really..)
- Styling updates
better multiplayer experience.
support maps that require other resources (Arcane dimensions)
Performance (everything having to be async is a real drag.. still trying to come up with solutions.)
thats awesome. how does the backend work? are players connected via P2P?
#30 posted by efess
on 2021/03/08 21:03:31
@jambalayaaaaa the backend runs mostly serverless AWS lambdas with S3 backend. The multiplayer is still client/server with server instances hosted in docker containers. Nginx provides layer7 routing for webquake clients, and udp is still port forwarded for native clients
You must be logged in to post in this thread.
Website copyright © 2002-2023 John Fitzgibbons. All posts are copyright their respective authors.