"alpha"-testing

Topics that are not maps. Discuss general map making concepts, techniques, contests, etc, here.

Moderators: Cartographers, Global Moderators

Forum rules
Please read the Community Guidelines before posting.

"alpha"-testing

Postby Catarah on Thu Dec 27, 2012 7:32 am

even though i don't comment too often in the foundry, i tend to lurk around here sometimes, and one thing has been bugging me lately.

whenever a map gets made, the playtesting starts only at the final stage. putting a map into beta means that everybody agrees the map is probably balanced, that the graphics are done, and that we only need to find out if we didn't miss any imbalances, before the map is put to play. other then xml-mistakes, spelling mistakes, or a slight adjustment of a bonus, we hardly ever change anything once it goes into beta.

now obviously, that's what a béta is about. the final stage of playtesting before the release. however, this does mean that we won't see a map into action until its nearly finished. to make up for the lack of actual testing, we've ended up with a lot of theories about what balanced maps are(usually based on previous experience), and thus we've ended up with a fairly conservative map making process. we apply the same set of theories to every new map that comes along, because we know it works.

however, this prevents us from finding out if some seemingly unbalanced settings can actually lead to a fun and balanced game. what i would suggest, is having an alpha "testing stage". were we can actually find out if new gameplay techniques work. basing the gameplay discussion not on theory, but on actual experience with the map. i can imagine that a map like city mogul can be improved a lot, since its our only map with such a bonus structure. wouldn't it be great if we could test out in the gameplay stage if a bonus of 30 or 50 works better? if adding a few more neutral countries would ruin the pacing, or would give the time needed for a balanced fight? would a map like arms race work better if each spy had different targets? if we maybe added a third spy? what is the effect of having the cannons of waterloo bombard eachother or not? etc. etc.

right now, all of these questions are theorized while we make the map, and then only changed if they don't work out in the beta. it seems to me however, that we could produce much better maps if we can test out a few different versions in an alpha stage, before deciding to stick with the version which plays best. Instead of assuming a map will be unbalanced, we can actually find it out before it enters the final forge.

so my suggestion would be to add an alpha testing stage to the process during the [gameplay] development of a map. a select group of people(or everybody, depends on how you want it), can test out the map on different settings, and the map maker can easily upload a new version every day with different suggestions or gameplay fixes. it wouldn't be a beautiful map - the graphics aren't done yet - but for the gameplay a map with army circles and clear borders is enough. This way, we can actually see what impact big changes have to the map, instead of knowing it only in theory.
Captain Catarah
 
Posts: 245
Joined: Fri Nov 27, 2009 11:17 am
Medals: 36
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (1) Freestyle Achievement (2) Nuclear Spoils Achievement (1) Fog of War Achievement (2)
Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (3)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (2) General Achievement (2) Clan Achievement (2)
Tournament Contribution (1)

Re: "alpha"-testing

Postby koontz1973 on Thu Dec 27, 2012 10:11 am

Catarah, this has been suggest many times before and rejected many times as well. Some maps have never been finished because a map maker wanted to go a different route and wanted to test their map first. As for a testing phase, you need to be able to play a map 1000+ times to find any and all bugs. Not spelling mistakes or bonus imbalances, just to see if the map works on all and every setting. You cannot see that in a limited testing as you suggested. This is the reason why beta takes so long. Months and months in fact even if nothing is reported as wrong.

As for new types of maps, that all comes down to the map makers. If they want to make conservative maps, they will. The blue game play boys are there to help make the maps, not to make them all alike. If a map makers has an idea and thinks it will work, as long as they can come up with a good reason why it will work, then it will be passed. But they will be asked to change it in beta if it does not work.

If you have a suggestion for a map that you think would work, then post in a thread and see if you can convince the map maker to do it.

But you are right in one thing, having the same map on different backgrounds is not making for a fun site. We do need variety in maps.
Sergeant 1st Class koontz1973
 
Posts: 7538
Joined: Thu Jan 01, 2009 10:57 am
Medals: 117
Standard Achievement (4) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (2)
Assassin Achievement (2) Manual Troops Achievement (2) Freestyle Achievement (1) Nuclear Spoils Achievement (2) Fog of War Achievement (4)
Trench Warfare Achievement (1) Teammate Achievement (1) Random Map Achievement (2) Cross-Map Achievement (3) Beta Map Achievement (2)
Ratings Achievement (4) Tournament Achievement (10) General Achievement (13) Clan Achievement (5) Map Contribution (12)
Tournament Contribution (31) General Contribution (10)

Re: "alpha"-testing

Postby Catarah on Sat Dec 29, 2012 7:37 am

alright. good to know that it has been considered, and it has been a concious decision not to include alpha testing.
even though i don't completely agree with your reasoning, at least i now understand the reasons.

thanks for the answer.
Captain Catarah
 
Posts: 245
Joined: Fri Nov 27, 2009 11:17 am
Medals: 36
Standard Achievement (3) Doubles Achievement (2) Triples Achievement (2) Quadruples Achievement (2) Terminator Achievement (1)
Assassin Achievement (1) Manual Troops Achievement (1) Freestyle Achievement (2) Nuclear Spoils Achievement (1) Fog of War Achievement (2)
Trench Warfare Achievement (2) Speed Achievement (2) Teammate Achievement (1) Random Map Achievement (1) Cross-Map Achievement (3)
Battle Royale Achievement (1) Ratings Achievement (2) Tournament Achievement (2) General Achievement (2) Clan Achievement (2)
Tournament Contribution (1)


Return to Foundry Discussions

Who is online

Users browsing this forum: No registered users

Login