SC2SEA.com - Starcraft 2 SEA eSports Community Site


  • Home
  • About
  • Streams
  • Features
  • Tournaments
  • Forums
Starcraft 2 SEA > sc2
About Us
An Overview of sc2sea
About Us
Contact us
Join our team!
Features
Live Streams
Replays
SEABets
Site Achievements
Articles
Article Archive
Who's Who
sc2sea.com Weekly Tournaments
Tournaments
Every Saturday BSG Open - (Bronze, Silver, Gold)
Every Sunday GPD Open - (Gold, Platinum, Diamond)
Monthly Sunday Masters Cup
Oseanic Championship Series 2015
Point Standings
The Grandmaster Manual
1. Introduction
2. Basics
3. Advanced
4. Anti-Cheese
5. Protoss
6. Zerg
7. Terran
8. Summary
9. Bonus Content!
Coaching
TGM Member Only Forums
TGM Official Coaches
Misc
Help us Rate TGM!!
Suggest what you'll like to see!
Need help? Contact Support!
Community Links
Members List
Search Forums
 
Advanced Search
Search Downloads
Advanced Search
Go to Page...
Community
House Clans
Clans
No recent threads.
Community
No recent threads.
Tournaments
No recent threads.
Latest Blogs New
tier list of people...
asdfSchnitzel
My Life Was Turned...
Sc2Clare
I've been playing...
SLCN.Wally
My Starcraft/eSpor...
syfChadMann
My Starcraft/eSpor...
syfChadMann
General
Stickied Threads
No recent threads.
General Threads
No recent threads.
StarCraft II
Starcraft General
No recent threads.
Strategy Discussion
No recent threads.
BSG Discussion
No recent threads.
Other Games
Other Games
No recent threads.
Sports
No recent threads.
News
News Archive
No recent threads.
Tournament News
No recent threads.
Articles Archive
Replays
Photo Gallery
Mark all forums as read
SC2SEA.com - Starcraft 2 SEA eSports Community Site Hide Replies

Blogs (/blogs/index.php)
-   Member Blogs (/blogs/browsecategory.php?c=3)
-   -   BETA: Replay Uploading Script (/blogs/showentry.php?e=199)

Dox Wed, 2nd-Nov-2011 11:16 AM

BETA: Replay Uploading Script
 
Back during the Wings of Liberty Beta, I advertised that I was looking for staff to help maintain a site I was putting together - http://www.SEA-Play.com, which was going to be a replay website focused around players in the SEA Community. The mission was simple: a user-driven replay hub of which staff/moderators could highlight the best games and showcase tournaments. Unfortunately, I only got a few nibbles from the community - most of which were inexperienced kids looking for opportunities to make a name for themselves.

And thus, due to travelling interstate for work for more than 2 weeks of each month over the course of 2010, SEA-Play was abandoned and I've since maintained the domain/server for nothing more than personal file storage.

Fortunately, with IPL4 Australia, WCG and TtCC wrapping up, I've bought myself a slight breather to "finish" this project off before things get crazy in about 2 weeks with ACL, Dox Cup #2 and so forth.

So I'm gonna try my best to complete the project - and bring it over to SC2SEA. As many people have recently suggested, one of the only limitations of SC2SEA is the Replay/File Management plugin. It's ugly, limited and doesn't offer much information.

What I need from the community, is for you guys to Beta test my Replay Parser and let me know what features you think it should contain.

Currently the raw script can be found here - and is available for testing:
http://sea-play.com/parser/upload_file.php

Ignore the DEBUG and TEST buttons - they're just for me.

Please try uploading various different replays and types of games and let me know your results. I need MASS data and MASS feedback to really drive this forward, so please - don't just upload a replay, think to yourself, "Cool", and close the tab. Let me know what you like. What you don't like. What you think is missing. What you think is unnecessary.

HOWEVER.

Please don't offer cosmetic suggestions! This is the RAW script, and definitely not the intended final design. When it is implemented, it'll be much prettier. Here's a sneak peak at what I have in mind:

+ [Show Huge Screenshot] +
Click the image to open in full size.


A few final comments:
  • I'll be implementing "League" functionality at some point, so you can specify which league each player is in.
  • I'll be implementing an "events" dropdown also, so you can publish whether the game belongs to MLG, Dreamhack, IEM, etc.
  • Ignore the events list, it'll be hidden on release.
  • I'm looking for feedback on the build order log. How detailed do you think it should be? Should I cap it at 6 minutes or so? Let me know.

That's all for now, and thanks in advance for your help!

EDIT: Results should look something like this for now.
+ [Show Image] +
Click the image to open in full size.


Hide Replies
SQLTt.yang Wed, 2nd-Nov-2011 11:32 AM

Re: BETA: Replay Uploading Script
 
It seems to be great! Is there a way you can add a filter to the event list? Maybe let the user change how much they want to see or if they don't want to see anything in particular?

Wed, 2nd-Nov-2011 11:33 AM

Re: BETA: Replay Uploading Script
 
As for the build order log, is something like what units were made possible to be extracted from the replay? (I.e. I think WC3Replays had this feature)

neon Wed, 2nd-Nov-2011 11:41 AM

Re: BETA: Replay Uploading Script
 
Just uploaded a file, all the information looks good, I think showing the whole build order might give too much away and make people a bit less likely to watch it, good to know how it starts. If there was a bit for someone to write a brief overview of the game would be nice too, but thats not specific to the replay parsing I guess.

I just did it to test the output and it looks good, I can test a bit more extensively at home tonight and provide some decent feedback, different browsers and such.

I think the features here are all useful, the apm graph maybe not so much, the unique unit id's I don't even know what is, and yeah the other parts you said you'd add sound good.

Dox Wed, 2nd-Nov-2011 11:44 AM

Re: BETA: Replay Uploading Script
 
Quote:
Originally Posted by SQLTt.yang
It seems to be great! Is there a way you can add a filter to the event list? Maybe let the user change how much they want to see or if they don't want to see anything in particular?
Yep, when browsing for replays in the database you'll be able to view a specific League (ie. MLG or IEM) and then a subcategory (Orlando, New York).

Quote:
Originally Posted by crAzerk
As for the build order log, is something like what units were made possible to be extracted from the replay? (I.e. I think WC3Replays had this feature)
That's actually already there, (underneath the APM charts) it's the part that I said to ignore 'cos I'm just using the default hex values from the MPQ instead of the actual unit names right now. At some point I'll replace them with graphics of each unit.

For example:
0x021101 = SCV
0x031001 = Marine
0x031301 = Marauder
+ [Show All] +
0x030901: 'Command Center',
0x030a01: 'Supply Depot (raised)',
0x021301: 'Supply Depot (lowered)',
0x004b01: 'Supply Depot (lowered) (2)',
0x031001: 'Command Center (upgrading to orbital command)',
0x002801: 'Orbital Command',
0x000c01: 'Barracks',
0x010e01: 'Factory',
0x011301: 'Factory (Flying)',
0x020701: 'Factory (Flying) (2)',
0x010f01: 'Starport',
0x020d01: 'Amory',
0x000f01: 'Bunker',
0x001101: 'Tech Lab (Addon)',
0x021101: 'SCV',
0x011601: 'SCV (Alternate, Building?)',
0x031001: 'Marine',
0x031301: 'Marauder',
0x001501: 'Hellion',
0x030d01: 'Seige Tank',
0x001401: 'Thor',
0x002d01: 'Larvae',
0x001301: 'Egg',
0x014101: 'Egg ..',
0x002301: 'Egg (Cocoon? Individual?)',
0x040301: 'Egg (fast spawning)',
0x080301: 'Egg (spawning stuffs..)',
0x020301: 'Egg (4 at a time?)',
0x010301: 'Egg (extra)',
0x008301: 'Egg (extra2)',
0x012901: 'Creep Tumor',
0x012001: 'Drone',
0x010401: 'Drone (Alternate)',
0x012101: 'Zergling',
0x001501: 'Zergling (Alternate)',
0x000b01: 'Baneling',
0x011101: 'Baneling (Alternate)',
0x022201: 'Roach',
0x012301: 'Hydralisk',
0x022301: 'Infestor',
0x022001: 'Mutalisk',
0x009001: 'Burrowed Unit (Drone)',
0x004801: 'Burrowed Unit (Drone) (2)',
0x002401: 'Burrowed Unit (Drone) (3)',
0x041001: 'Burrowed Unit (Drone) (4)',
0x021001: 'Burrowed Unit (Drone) (5)',
0x002701: 'Burrowed Unit (Zergling)',
0x002601: 'Burrowed Unit (Roach)',
0x021201: 'Burrowed Unit (Roach) (2)',
0x041201: 'Burrowed Unit (Roach) (3)',
0x010a01: 'Burrowed Unit (Roach) (4)',
0x011201: 'Unburrowing (Roach)',
0x040a01: 'Unburrowing (Roach) (2)',
0x020a01: 'Unburrowing (Roach) (3)',
0x032501: 'Overseer',
0x032401: 'Overseer Cocoon',
0x040201: 'Baneling Cocoon',
0x020201: 'Baneling Cocoon (2)',
0x010201: 'Baneling Cocoon (3)',
0x002201: 'Baneling Cocoon (4)',
0x011001: 'Baneling Cocoon (5)',
0x000a01: 'Baneling Cocoon (6)',
0x022601: 'Queen',
0x012201: 'Overlord',
0x001e01: 'Hatchery',
0x003e01: 'Extractor',
0x011c01: 'Extractor (building?)',
0x011d01: 'Spawning Pool',
0x031e01: 'Spine Crawler',
0x011e01: 'Evolution Chamber',
0x031f01: 'Spore Crawler',
0x031d01: 'Roach Warren',
0x021e01: 'Infestation Pit',
0x011f01: 'Hydralisk Den',
0x031c01: 'Baneling Nest',
0x021c01: 'Spire',
0x002001: 'Lair',
0x011701: 'Nexus',
0x021401: 'Pylon',
0x021501: 'Assimilator',
0x021701: 'Forge',
0x021601: 'Gateway',
0x002901: 'Warp Gate',
0x011801: 'Cybernetics Core',
0x031501: 'Twilight Council',
0x001801: 'Templar Archives',
0x001b01: 'Robotics Facility',
0x001a01: 'Robotics Bay',
0x031701: 'Stargate',
0x001c01: 'Probe',
0x041101: 'Probe (Alternate)',
0x007001: 'Probe (Alternate)',
0x011901: 'Zealot',
0x006e01: 'Alternate Toss (6e01) (Void/Pheonix)',
0x006c01: 'Alternate Toss (6c01) (Void/Pheonix)',
0x006901: 'Alternate Toss (6901) (Sentry/Immortal)',
0x001d01: 'Alternate Toss (1d01) (Colossus)',
0x006601: 'Alternate Toss (6601) (Stalker)',
0x006501: 'Alternate Toss (6501) (Zealot)',
0x006f01: 'Alternate Toss (6f01) (Sentry/Immortal)',
0x011a01: 'Stalker',
0x021901: 'Sentry',
0x011b01: 'High Templar',
0x031a01: 'Observer',
0x031b01: 'Immortal',
0x030501: 'Colossus',
0x021a01: 'Pheonix',
0x031801: 'Void Ray',
0x034201: 'Destructible Rocks',
0x034301: 'Destructible Rocks (2)',
0x024101: 'Destructible Debris',
0x032901: "Xel'Naga Tower",
0x003d01: 'Mineral Field',
0x022b01: 'Rich Mineral Field',

etc.

Dox Wed, 2nd-Nov-2011 11:50 AM

Re: BETA: Replay Uploading Script
 
Quote:
Originally Posted by neon
I think showing the whole build order might give too much away and make people a bit less likely to watch it, good to know how it starts.
Yep, I definitely intend on trimming it, but I'm not sure how deep into the game? Any suggestions? It'll appear in a separate tab, nonetheless.

Quote:
If there was a bit for someone to write a brief overview of the game would be nice too, but thats not specific to the replay parsing I guess.
I'll include a comments/description section.

Quote:
I think the features here are all useful, the apm graph maybe not so much, the unique unit id's I don't even know what is, and yeah the other parts you said you'd add sound good.
Thanks!

nirvAnA Wed, 2nd-Nov-2011 12:54 PM

Re: BETA: Replay Uploading Script
 
This is AMAZING!!!! Dox so much for this! I would say having the chat / APM and your new interface everything is already pretty much there already and will be a huge improvement over our current replay system.

Build order should be whole game maybe capped at 20mins to prevent the excessively long 1hr games from messing it up. 20 mins so people can analyse games just by looking at the summaries, would be so cool and yea anyone wanting to click the BO is already going to get a spoiler so why not make it 20 mins instead of 6 where u cant really see anything (like the bnet histories tell so little). BO as it is now (like the bnet history) seems fine, dunno how more detailed it can be.. what else can be added?

+ [Some extra features i would love to see] +


The following are just extra/bonus suggestions if you have time for them.

1. Improved Widget
Will have a Navbar tab in the main menu which links to the replay main navigation section. What would be great too is an updated iframe widget which will be placed on the right which has a filter to switch the display between "Featured SEA games", "Featured games (worldwide-mlg etc)" and "User Submitted games." Only admins/mods/designated uploaders can upload into the first 2 categories. And there is also a quick link download on the right of the file name (like TL's replay system) so pple can just dl based on the title without having to go into the description.

2. Search
quick search function which is also linked to the parser's words

clicking on player name brings up a serach for all other replays from that player
clicking on map brings up a search for all games on that map
clicking on race matchup ....
clicking on a competition (e.g dox cup 1)....
clicking on a league..
clicking on the uploader ....

More of these "Super Extras" aka basically stuff i dream off in my sleep.

vb integration - comments tied in to vbulletins comment system, counts as a post maybe? and in their profile theres a "uploaded replays" so i just put a $uploadedreplays in the profile post bit somewhere and it displays

a mass upload feature from zip files for admins (should the site ever become replay focus such that pple all over the world come to visit just for the good replay system and frequent top replays posted, i would probably hire someone to regular upload all the top replays every day and uploading thru zip like MLG replay packs etc gonna be alot easier. for him)

wondering how you gonna extra information like country from players. maybe it can be linked to a primitive version of a "SEA DB". so all known handles of iaguz iaguz/altiaguz/xkgking iaguz will be associated with their player db profile and mods can edit these profiles which can contain other information too like their RL picture, country, team, catchphrase etc. or have the results of the replays add statistics to the players so like after a CO the winner goes like 8-0 or something and thats added to his profile and the stats are of course skewed by the pple who bother to upload replays but yea basically im just dreaming in all of these bottom suggestions lol

Ridiculisk Wed, 2nd-Nov-2011 4:36 PM

Re: BETA: Replay Uploading Script
 
Very nice Dox, I uploaded a few replays and think everything looks good.

My only suggestion relates to the BO's it displays. It's an awesome feature to be able to display the actual BO out of a replay, so I think that feature needs to stay, maybe add another little link thingy after the 'Show Winner' spoiler (in your example) that says; Display BO Player [1/2] just so it doesn't clog stuff up for the casual players who just wanna watch replays, while those of us who are interested in in-depth analysis can actually see the BO and learn from it.

Obviously it's gonna look prettier than it does right now, so far so good.

System Wed, 2nd-Nov-2011 4:39 PM

Re: BETA: Replay Uploading Script
 
DOX!

I need to know how to extract data from a replay file, I have been wanting to make a program but can't find any information on how to get information from a replay file.

Bugalugs McScruffin Thu, 3rd-Nov-2011 7:40 AM

Re: BETA: Replay Uploading Script
 
System, I assume you just read it as in input stream, bytes at a time. You just gotta know what they bytes mean.

Dox can elaborate.

Dox Thu, 3rd-Nov-2011 7:48 AM

Re: BETA: Replay Uploading Script
 
Hmmm, shall reply to the latest posts a bit later today, but in the meantime a bug seems to have been highlighted by Pinder.

A 28 minute game on Antiga Shipyard is listing both players as having 1 APM. The entire chat log is parsed, however the APM/Units Produced/Build order is only capturing the first ~8 seconds of the game. Worrying!

I'll try to figure out what's wrong, I've only got like 2 weeks to finish this and then I'm busy again! So please, keep the feedback coming.

Zepph Thu, 3rd-Nov-2011 9:34 AM

Re: BETA: Replay Uploading Script
 
Very much like Doxfriend

For improvements I think trimming the "all events" section by what is actually displayed. For example instead of having "trains a pair of zerglings" written 8 times maybe instead have it recognise repetitions in the table and count them to spit out "trains a pair of zerglings x8" or something.

As far as additions go I'd maybe like to see a little more in terms of the economy? Workers created, resources mined, peak income...things like that

One last thing is in uploading a tourney game I casted, quite a few other people were obsing and the chat that your parser outputs includes both chat between the players and everything the spectators said as well because I wasn't referee. It would be good to filter this out if possible .

LoRDo Tue, 7th-Feb-2012 9:07 PM

Re: BETA: Replay Uploading Script
 
I'd actually be very interested in helping out with this site.

Hit me up on skype (see below) or some such if you're still putting out the calling.

Would also be interested in helping out with the development (I have a fair bit of web development experience).

(p.s. love the mock up idea)


Powered by: vBadvanced Dynamics v1.2.0
Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
Events
Upcoming Events Add
No events scheduled in
the next 7 days.
OSC SEA Participation Bonus
Live Streams
No streams online.
Open SEABets
No open bets.
2015 OSEANIC Series
Latest Results
Americas Open #110 KeeN
OSC SEA Weekly #24 Probe
SC2Online Comm Open #38 aLive
February EU Ladder Heroes Nerchio
February NA Ladder Heroes TRUE
ANZ Cup #12 iaguz
Filthy NA Weekly #16 Semper
Proxy Tempest Open #43 PiLiPiLi
Top 20 OSC Rankings
1ByuN
2Seither
3DemiLove
4PiLiPiLi
5Kelazhur
6Cham
7iaguz
8aLive
9Solar
10KeeN
11EnDerr
12KingkOng
13TRUE
14GuMiho
15Probe
16puCK
17Snute
18PandaBearMe
19PiG
20Ryung
Full Point Standings
Earn extra points with Challenge Matches!
Bounties
Defeat these players and collect the $'s!
ByuN$100
INnoVation$75
Solar$75
Neeb$60
herO$50
GuMiho$50
Nerchio$50
TRUE$50
uThermal$50
Kelazhur$40
MajOr$40
Scarlett$40
Snute$40
aLive$30
Bly$30
iAsonu$30
KeeN$30
PiLiPiLi$30
puCK$30
Ryung$30
Cham$25
Cyan$25
iaguz$25
Guru$25
Seither$25
Semper$25
JonSnow$15
PandaBearMe$15
Probe$15
Latest Collected
Yours 2-0 Neeb $60
SC2ONLINE Comm Open #38
Azure 2-0 Seither $25
ANZ Cup #12
Cham 2-0 Cyan $25
OSC All Stars #24
FuturE 2-0 KeeN $30
ESL Americas Open #109
Donations
Donate using Paypal!

Even the smallest donations help keep sc2sea running! All donations go towards helping our site run including our monthly server hosting fees and sc2sea sponsored community tournaments we host. Find out more here.

Powered by: vBadvanced Dynamics v1.2.0
Home - Contact Us - FAQ - Members List - Advertise - Terms of Service - Top - Mobile-friendly (alpha)
Powered by vBadvanced CMPS v3.2.2
Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2026, vBulletin Solutions, Inc.
The contents of this webpage are copyright of sc2sea.com © 2010-2015. All Rights Reserved.
The Grandmaster Manual is a Starcraft 2 Guide created and owned by sc2sea.com
Starcraft2 is a trademark of Blizzard Entertainment, this is a community fan site and no infringement is intended.
Custom artwork by Zeus, Banner designed by Cute, other artworks is used with permission with credits listed here. vBulletin skin by CompletevB.com