moth/doc/2011-03-TF3/survey-results.html

329 lines
21 KiB
HTML

<!DOCTYPE html>
<html><head><title>Survey results</title></head><body>
<table>
<tr><th>Class</th>
<th>instructor</th>
<th>classroom</th>
<th>class-content</th>
<th>contest-setup</th>
<th>contest-ambiance</th>
<th>contest-network</th>
<th>contest-lanl</th>
<th>contest-sandia</th>
<th>contest-vendors</th>
<th>hotel</th>
<th>Comments</th></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★★ </td>
<td><!-- hotel -->★★★ </td>
<td></td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★ Useful techniques, but no practical training on how to identify what data should be flagged for deeper analysis (e.g. how do you find the data that you will then try to crack)</td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★ </td>
<td><!-- contest-sandia -->None </td>
<td><!-- contest-vendors -->★★★ Solera was actually practical as it walked you through part of an investigation</td>
<td><!-- hotel -->★★ albuquerque would be more convenient</td>
<td>It would be nice to take a more practical approach to the training and exercise. E.g. Here are some things you would do to identify areas of concern and then go into the investigation of the data. Exercises could be less "random" and tied together better.</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★★ Everyone was awesome. Great job guys! </td>
<td><!-- classroom -->★★ If you were in the back of the room the board was little hard to see.</td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★ The challenges were tough. However, the answer server could use some improvement in the way it accepts answers, or make it more clear what format it needs to be in. A lot of time was spent trying to enter the answer in the right syntax after we got it. </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★★ </td>
<td><!-- hotel -->★★ The food was good. The rooms were a tad small.</td>
<td>Overall the conference was very good.</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★ 1% instruction, more of a sink or swim- Here ya go. I thought this was a training course.</td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★ There wasn't much teaching. Seemed to be a exercise of what you already knew. Signed up to learn. Moved to Malware RE the second day were they were teaching.</td>
<td><!-- contest-setup -->★★ Would be better with some elbow room. 7 laptops and a desktop on a small round table doesn't work so well.</td>
<td><!-- contest-ambiance -->★★★ Just loud enough, Chairs were uncomfortable</td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★ Would have better to have a true capture the flag instead of puzzles. Maybe each team gets a server and must protect and attack others.</td>
<td><!-- contest-sandia -->★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★★ </td>
<td></td></tr>
<tr style="border: 2px solid black"><td></td>
<td><!-- instructor -->★★ too many to give an accurate judgement. some good, some so-so</td>
<td><!-- classroom -->★★ worked well. Noisy AC hurt hearing at time. </td>
<td><!-- class-content -->★★ Slides were way to crowded and ahrd to read. If you were not familiar with the tools, the fast clicking through windows hurt.</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★ understanding the voince from beyond over the music was difficult. Probably fine of you live in a leet underworld and are used to the accent.</td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->None forensics puzzles needed to be replaced. Answers needed verificaion and format specified.
<br></td>
<td><!-- contest-sandia -->None Limiting it to 1 thing being worked on at a time for the group was a bad design. Loosing points as others attempt to work on other pieces.</td>
<td><!-- contest-vendors -->★★ Finding your way through solera would be easier if it was commonly used. Attempting to find what they anted through a gui is much more difficult that what I normally do vai dumping pcap.</td>
<td><!-- hotel -->★★ A strange but interesting place. needed increaed water pressure if you want a hot shower.</td>
<td>With the forensics puzzles, having the same for the classroom vs the contest helped those that took close notes. There is way too much use of Encase and limits on how far yoyu can get if you are unfamiliar with it. </td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★ 1% instruction, more of a sink or swim- Here ya go. I thought this was a training course.</td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★ There wasn't much teaching. Seemed to be a exercise of what you already knew. Signed up to learn. Moved to Malware RE the second day were they were teaching.</td>
<td><!-- contest-setup -->★★ Would be better with some elbow room. 7 laptops and a desktop on a small round table doesn't work so well.</td>
<td><!-- contest-ambiance -->★★★ Just loud enough, Chairs were uncomfortable</td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★ Would have better to have a true capture the flag instead of puzzles. Maybe each team gets a server and must protect and attack others.</td>
<td><!-- contest-sandia -->★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★★ </td>
<td></td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★ </td>
<td>Please... somewhere with faster, more reliable internet next year.</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★ </td>
<td>Please... somewhere with faster, more reliable internet next year.</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★ </td>
<td>Please... somewhere with faster, more reliable internet next year.</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ If students should use python3, then all the examples should be in python3</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★★ </td>
<td></td></tr>
<tr style="border: 2px solid black"><td>none</td>
<td><!-- instructor -->None Didn't attend</td>
<td><!-- classroom -->None Didn't attend</td>
<td><!-- class-content -->None Didn't attend</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->None Didn't focus on it</td>
<td><!-- contest-vendors -->None Didn't focus on it</td>
<td><!-- hotel -->★★★ </td>
<td>More stuff like WOPR / octopus / pwnables / printf!</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★ The portions of the instruction that were lecture only could have been improved by having students follow along and actually participate. For example, instead of teaching Windows Registry purely by lecture, have students open Regex or examine the Registry using EnCase.</td>
<td><!-- classroom -->★★★ Good facilities and connections. No complaints.</td>
<td><!-- class-content -->★★★ Aside from the pure lecture portions, the content was good. Exactly what I expected when signing up for a forensics course. Good that not a lot of time was devoted to teaching the basics of the programs, like EnCase.</td>
<td><!-- contest-setup -->★★★ Good facilities and connections. No complaints.</td>
<td><!-- contest-ambiance -->★★ Would it kill you to play a little Smokey Robinson? ;)</td>
<td><!-- contest-network -->★★★ No complaints.</td>
<td><!-- contest-lanl -->★★★ Awesome puzzles and contests. So much to keep everyone busy. Maybe a little too much material for smaller teams to even make a dent in scoring points. My only complaint is the way in which answers are required to be formatted. See the General Comments section for more detail.</td>
<td><!-- contest-sandia -->★★ I didn't really participate much in the Sandia Jeopardy business. From what I saw, it looked good.</td>
<td><!-- contest-vendors -->★★★ Good way to show off their products without it being just a sales pitch. The puzzles they provided were great.</td>
<td><!-- hotel -->★★★ Nice. No complaints.</td>
<td>Participants should not have to decipher the format of the answer for the questions on their own. Dates/times entries either need to be in a precise, specified format or the system should be able to taken input and determine whether or not the correct answer is known. Whether or not an answer is correct should be determined by upper or lower case letters. The scoring systems should be able to compare the data submitted and normalize the input and compare it to the correct answer.</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★ </td>
<td><!-- classroom -->★★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★ Not a fan of house music, other than that it was great</td>
<td><!-- contest-network -->★ serious issues, I do not know what to tell you about how to fix it but it was "spotty" at best</td>
<td><!-- contest-lanl -->★★ more HINTS for newbs</td>
<td><!-- contest-sandia -->★★ Good, but got complicated with the NAS and the storage and the file management and stuff, that could be implemented better</td>
<td><!-- contest-vendors -->★★★ The fireeye got hard fast, which means I did not finish, but it also means that their system didn't get totally utilized right?</td>
<td><!-- hotel -->★★★ the laFonda was pretty awesome actually</td>
<td>I hope eI get to keep coming to these, this has been a great culmination of the first few years of my experience as a cyber analyst and it was great to see that I am indeed actually learning something.</td></tr>
<tr style="border: 2px solid black"><td></td>
<td><!-- instructor -->None </td>
<td><!-- classroom -->None </td>
<td><!-- class-content -->None </td>
<td><!-- contest-setup -->None </td>
<td><!-- contest-ambiance -->None </td>
<td><!-- contest-network -->None </td>
<td><!-- contest-lanl -->None </td>
<td><!-- contest-sandia -->None </td>
<td><!-- contest-vendors -->None </td>
<td><!-- hotel -->None </td>
<td></td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★★ </td>
<td><!-- hotel -->★★★ </td>
<td>This is really great material and the puzzles are very well presented. The entire exercise is extremely well organized.
This lacking was my background knowledge.
Next time I am going to be a lot more prepared for the challenges.
This was my first ever Capture the flag and participation in a exercise like this but you certainly have found a permanent participant.
A+++++ will do it again.
Tracerfire starts from where all the text books ends.
</td></tr>
<tr style="border: 2px solid black"><td>none</td>
<td><!-- instructor -->None Did not attend the class</td>
<td><!-- classroom -->None Did not attend the class</td>
<td><!-- class-content -->None Did not attend the class</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★ Music was a little loud and repetitive (it's techno!)</td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ Learned tons!</td>
<td><!-- contest-sandia -->None Did not play these ones</td>
<td><!-- contest-vendors -->★★★ Solera was interesting</td>
<td><!-- hotel -->None Did not use the hotel</td>
<td>First time at a capture the flag competition. Learned a lot!</td></tr>
<tr style="border: 2px solid black"><td></td>
<td><!-- instructor -->★★★ The Dr was good</td>
<td><!-- classroom -->★★ seats sucked</td>
<td><!-- class-content -->★★★ good stuff</td>
<td><!-- contest-setup -->★★ tables, eh. room ok</td>
<td><!-- contest-ambiance -->★★ purdy good</td>
<td><!-- contest-network -->★★ worky most of the time</td>
<td><!-- contest-lanl -->★★ </td>
<td><!-- contest-sandia -->★★ </td>
<td><!-- contest-vendors -->★ Solera example was weak</td>
<td><!-- hotel -->★★ bar good. room ok.</td>
<td>Thanks for the hard work! A little more intro to the contest and expectations for the n00bs would be good....</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★ Not enough instructing. Mostly just "here's puzzles' solve them.</td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ Good material to learn on; just need more teaching, and more response to questions.</td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★ </td>
<td><!-- contest-network -->★ Terrible. I often had to reload a dozen times to submit a solution. Also, being unable to reach the internet made this very frustrating and much less fun.</td>
<td><!-- contest-lanl -->★★★ Great material. Wish we had been introduced better to actually doing things; most categories my team had no idea how to even begin on, and contest time was not an environment that allowed us to learn in.</td>
<td><!-- contest-sandia -->None </td>
<td><!-- contest-vendors -->None </td>
<td><!-- hotel -->None </td>
<td>The contest material was really good, but nobody on my team knew how to approach (or even find!) most of it. Maybe this would be fixed by better team distribution, but it would be likely that someone skilled would just take over, instead of teaching other people. Thus, I ended up feeling really frustrated that I wasn't actually learning anything, and just feeling punished for the things I didn't know or couldn't do (which was most of the contest).</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★ Paul clearly knows his stuff; however, his explanations weren't always clear.</td>
<td><!-- classroom -->★★ difficult to see the few onscreen examples</td>
<td><!-- class-content -->★★ it wasn't lame, but didn't find the info useful for the challenge days. :(</td>
<td><!-- contest-setup -->★★ room was fine. tables were a bit small. Really like the provided forensic workstations with pre-loaded tools.</td>
<td><!-- contest-ambiance -->★★ light was better than last year's event. Music wasn't great on day 1, "felt the rhythm" on day 2.</td>
<td><!-- contest-network -->★★★ awesome</td>
<td><!-- contest-lanl -->★★ overall good. some stuff was just unrealistic</td>
<td><!-- contest-sandia -->★★ overall good. some stuff was just unrealistic...and some was just funny!</td>
<td><!-- contest-vendors -->★★ really liked the idea of vendors offering their own challenges! I didn't get to work on them very much though (other team members)</td>
<td><!-- hotel -->★★★ location was great! lots of choices for dinner and lunch downstairs was spot-on every day! the breakfast food was lame though </td>
<td>I think Tracer should foster more "forced" interaction--the idea of information sharing is key...beyond the event, within our real jobs. I would like better or just more classroom hours. Maybe a full week of class room and a weekend of challenges would be cool. thanks for all the hard work!</td></tr>
<tr style="border: 2px solid black"><td>none</td>
<td><!-- instructor -->★★ NA</td>
<td><!-- classroom -->★★ NA</td>
<td><!-- class-content -->★★ NA</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★ can't say</td>
<td><!-- hotel -->★★ NA</td>
<td></td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★ Come on, we expected some one teach something otherwise all those questions can be found through Internet.</td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★ </td>
<td><!-- contest-setup -->★★ </td>
<td><!-- contest-ambiance -->★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★★ </td>
<td><!-- hotel -->★★ </td>
<td>I dont think I learn alot</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★ </td>
<td><!-- contest-setup -->★★ Several inconvenient network outages.</td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network --></td>
<td><!-- contest-lanl -->★★ </td>
<td><!-- contest-sandia -->★★ </td>
<td><!-- contest-vendors -->★★ </td>
<td><!-- hotel -->★★★ </td>
<td>Fun competition. Could have used more communication among the people who wrote the questions.</td></tr>
<tr style="border: 2px solid black"><td>host</td>
<td><!-- instructor -->★★ Varied. Not having the slides the first day made following along very difficult.</td>
<td><!-- classroom -->★★ Screens were sometimes hard to see and chairs weren't comfortable.</td>
<td><!-- class-content -->★★ Too Windows and Encase centric to justify another trip.</td>
<td><!-- contest-setup -->★★ No real issues except the chairs.</td>
<td><!-- contest-ambiance -->★★★ No complains here.</td>
<td><!-- contest-network -->★★ Didn't have any major issues and Internet access table was very fast.</td>
<td><!-- contest-lanl -->★★ Wasn't really aware there was different content between the sites except for some of the instructors.</td>
<td><!-- contest-sandia -->★★ </td>
<td><!-- contest-vendors -->★★ Didn't attempt</td>
<td><!-- hotel -->★★ All the shops close at 5pm so there's not much to do except eat and drink. Hotel WiFi was really slow. No vending machines?!</td>
<td>Learned some interesting things, met some very interesting people, and got a different perspective on security, but can't justify another trip for myself or a fellow system administrator with the content and exercises used this year.</td></tr>
<tr style="border: 2px solid black"><td>net</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★★ </td>
<td><!-- class-content -->★★★ Problems were hard I learned a lot.</td>
<td><!-- contest-setup -->★★★ </td>
<td><!-- contest-ambiance -->★★★ </td>
<td><!-- contest-network -->★★★ </td>
<td><!-- contest-lanl -->★★★ </td>
<td><!-- contest-sandia -->★★★ </td>
<td><!-- contest-vendors -->★★★ </td>
<td><!-- hotel -->None </td>
<td>The network ran well. problems were hard. thanks for the effort.</td></tr>
<tr style="border: 2px solid black"><td>malware</td>
<td><!-- instructor -->★★★ </td>
<td><!-- classroom -->★★ </td>
<td><!-- class-content -->★★★ </td>
<td><!-- contest-setup -->★★ uncomfortable chairs</td>
<td><!-- contest-ambiance -->★★ music was a bit too loud</td>
<td><!-- contest-network -->★★ better access to internet</td>
<td><!-- contest-lanl -->★★★ first time, so it must be great</td>
<td><!-- contest-sandia -->★★★ see above</td>
<td><!-- contest-vendors -->★★ didn't touch it, so i have no idea</td>
<td><!-- hotel -->★★ did not stay in hotel</td>
<td></td></tr>
</table>
</body></html>