-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathResearch.html
More file actions
362 lines (341 loc) · 15.8 KB
/
Copy pathResearch.html
File metadata and controls
362 lines (341 loc) · 15.8 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
<!DOCTYPE HTML>
<!--
Editorial by HTML5 UP
html5up.net | @ajlkn
Free for personal and commercial use under the CCA 3.0 license (html5up.net/license)
-->
<html>
<head>
<title>UCL Systems Engineering Project: Team 2</title>
<meta charset="utf-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1, user-scalable=no"/>
<!--[if lte IE 8]>
<script src="assets/js/ie/html5shiv.js"></script><![endif]-->
<link rel="stylesheet" href="assets/css/main.css"/>
<!--[if lte IE 9]>
<link rel="stylesheet" href="assets/css/ie9.css"/><![endif]-->
<!--[if lte IE 8]>
<link rel="stylesheet" href="assets/css/ie8.css"/><![endif]-->
<!-- Scripts -->
<script src="assets/js/jquery.min.js"></script>
<script src="assets/js/skel.min.js"></script>
<script src="assets/js/util.js"></script>
<!--[if lte IE 8]>
<script src="assets/js/ie/respond.min.js"></script><![endif]-->
<script src="assets/js/main.js"></script>
<script>
$(function(){
$("#sidebar1").load("Sidebar.html");
});
</script>
</head>
<body>
<!-- Wrapper -->
<div id="wrapper">
<!-- Main -->
<div id="main">
<div class="inner">
<!-- Header --><!--
<header id="header">
<a href="index.html" class="logo"><strong>COMP204P</strong></a>
</header> -->
<!-- Banner -->
<section id="banner">
<div class="content">
<header>
<h1>Research</h1>
</header>
</div>
</section>
<section id="decisions">
<h2>Decisions</h2>
<p>
Since on different aspects, we will have several technologies to use, so we have some discussios on
them.
And below are the conclusions we made on different part of the project, with advantages and
disadvantages.
</p>
<p>Programming Language:</p><br>
<h3 align="center">C# vs F#</h3>
<table>
<tbody>
<tr>
<td align="center"><h4>C#</h4></td>
<td align="center"><h4>F#</h4></td>
</tr>
<tr>
<td align="center">Plenty of libraries available to use</td>
<td align="center">Some libraries not comfortable for F#</td>
</tr>
<tr>
<td align="center">Simple to program</td>
<td align="center">Good for complex algorithm programming</td>
</tr>
<tr>
<td align="center">Faster when executing</td>
<td align="center">Shorter code</td>
</tr>
<tr>
<td align="center">Easier for object-oriented programming</td>
<td align="center">F# projects work in C# projects</td>
</tr>
</tbody>
</table>
<p>Set Storage:</p><br>
<h3 align="center">Azure Cloud Blob vs Database on VM Server</h3>
<table>
<tbody>
<tr>
<td align="center"><h4>Azure Cloud Blob</h4></td>
<td align="center"><h4>Database on VM Server</h4></td>
</tr>
<tr>
<td align="center">Good for storing large strings<br>File structure<br>
simple to navigate
</td>
<td align="center">Faster than reading data from <br>
cloud based storage system<br>
(from speed tests)
</td>
</tr>
<tr>
<td align="center">Easy to scale
</td>
<td align="center">Hard to scale and add new tables</td>
</tr>
<tr>
<td align="center">Data is backed up automatically by Microsoft</td>
<td align="center">We have to handle backing up ourselves<br>
as the database will be on the local machine
</td>
</tr>
</tbody>
</table>
<p>Splitting Sets Into Subsets:</p>
<h3 align="center">Decision Tree vs NeuralNetwork Model(ANN)</h3>
<table>
<tbody>
<tr>
<td align="center"><h4>Decision Tree</h4></td>
<td align="center"><h4>ANN</h4></td>
</tr>
<tr>
<td align="center">Easy to visualise underlying concepts and mechanisms</td>
<td align="center">Many parameters to test(e.g. hidden layer size,<br>
number of hidden layers, different activation functions)<br>
more prone to overfitting<br></td>
</tr>
<tr>
<td align="center">Quick to implement</td>
<td align="center">Require large data set</td>
</tr>
<tr>
<td align="center">Works well with simple problems</td>
<td align="center">Works well with complex problems</td>
</tr>
<tr>
<td align="center">Easy to learn</td>
<td align="center">Difficult to debug</td>
</tr>
</tbody>
</table>
<p>Data Transmission:</p>
<h3 align="center">ZIP vs JSON Formatted String vs UDP</h3>
<table>
<tbody>
<tr>
<td align="center"><h4>ZIP</h4></td>
<td align="center"><h4>JSON Formatted String</h4></td>
<td align="center"><h4>UDP</h4></td>
</tr>
<tr>
<td align="center">Saves space</td>
<td align="center">Syntax is small and light weighted</td>
<td align="center">Do no need any connection setup</td>
</tr>
<tr>
<td align="center">Reduce transmission time</td>
<td align="center">Execute responses faster</td>
<td align="center">Do not need to retransmit lost packets</td>
</tr>
<tr>
<td align="center"></td>
<td align="center">Wide range of supported browser<br>
compatibility with operation systems
</td>
<td align="center"></td>
</tr>
<tr>
<td align="center"></td>
<td align="center">Superior file format for web APIs</td>
<td align="center"></td>
</tr>
</tbody>
</table>
<p>In Memory Set Manipulation:</p>
<h3 align="center">C# Hashset vs Dictionary</h3>
<table>
<tr>
<td align="center"><h4>C# Hashset</h4></td>
<td align="center"><h4>Dictionary</h4></td>
</tr>
<tr>
<td align="center">Supports multiple readers whereas Dictionary<br>
only supports a single reader at any one time
</td>
<td align="center">Slight performance gain on boxing and unboxing</td>
</tr>
<tr>
<td align="center">Relies on rehashing to resolve collisions<br>
becomes slower as dataset increases
</td>
<td align="center">Relies on chaining to resolve collisions.<br>
Resizing the hash table is not required as all<br>
hash collisions are resolved by appending the new<br>
item to the end of the linked list of the hash index.<br>
Meaning Dictionaries are much faster for large sets.<br>
No boxing and unboxing further speed improvements.
</td>
</tr>
<tr>
<td align="center"></td>
<td align="center">Generic type so can be used with any type</td>
</tr>
</table>
<p>Efficiency:</p>
<h3 align="center">Multi-Threading vs Single-Threading</h3>
<table>
<tr>
<td align="center"><h4>Multi-Threading</h4></td>
<td align="center"><h4>Single-Threading</h4></td>
</tr>
<tr>
<td align="center">Improved performance and concurrency</td>
<td align="center">Easy to debug and test</td>
</tr>
<tr>
<td align="center">Better use of CPU resources</td>
<td align="center">Easy to code</td>
</tr>
<tr>
<td align="center">Simplified and streamlined program coding</td>
<td align="center"></td>
</tr>
</table>
<p>Chart Generation:</p>
<h3 align="center">Front End vs Back End</h3>
<table>
<tr>
<td align="center"><h4>Front End</h4></td>
<td align="center"><h4>Back End</h4></td>
</tr>
<tr>
<td align="center">Greater flexibility and variety with sets.</td>
<td align="center">C# is faster than Javascript so the graphs<br>
can be generated in a shorter amount of time
</td>
</tr>
<tr>
<td align="center">Massive amounts of customisation</td>
<td align="center">Sending a Chart Object as a JSON is significantly<br>
faster than sending sets containing potentially<br>
millions of data points across a TCP connection.
</td>
</tr>
<tr>
<td align="center"></td>
<td align="center">Allows back end developers to better understand<br>
requirements of the front end developers thereby<br>
improving communication.
</td>
</tr>
<tr>
<td align="center"></td>
<td align="center">More flexibility for front end developers as<br>
they have the option to retrieve a dataset<br>
or a graph object.
</td>
</tr>
</table>
</section>
<section id="summary">
<h2>Summary</h2>
<p>In summary, we used C# as programming language since this project is object-oriented, and also we are
more familiar with C# than F#,
so it is easier and more comfortable for us to use C#.</p>
<p>For data storage, we used Azure Blob storage because it's much faster to read data and cleaner to
browse,
and we don't need to worry about the loss of data since it's automatically backed up by
Microsoft.</p>
<p>In modelling section, we used Decision Tree. It's not a really huge task of set classification, so
using Decision Tree
is simpler and easier for us to use.</p>
<p>For data transmission, we have JSON Formatted String for first choice because it's much simpler and
faster when transmitting data.
We also have the options for ZIP transfer.</p>
<p>We decided to include the Chart Engine option in the backend because Team 1 were performing the exact
same tasks as the Chart Engine. It is much simpler to send a Chart object across a REST endpoint
than sets since sets can vary in size of up to several MB whereas Chart objects will be no more than
a few KB. </p>
</section>
<section id="source">
<h2>Sources</h2>
<p>
<table>
<thead>
<tr class="success">
<th>Research Area</th>
<th>Resources</th>
<th>Links</th>
</tr>
</thead>
<tbody>
<tr>
<td>Programming Language</td>
<td width="900">Microsoft Website<br>Wikibooks</td>
<td>https://msdn.microsoft.com/en-us/<br>https://en.wikibooks.org/wiki/F_Sharp_Programming/Basic_Concepts
</td>
</tr>
<tr>
<td>Set Storage</td>
<td width="900">Azure Website</td>
<td>https://azure.microsoft.com/en-gb/services/storage/blobs/</td>
</tr>
<tr>
<td>Splitting Sets</td>
<td width="900">Scikit-learn Docs<br>Machine Learning A Probabilistic Overview</td>
<td>http://scikit-learn.org/stable/modules/tree.html<br>https://mitpress.mit.edu/books/machine-learning-0
</td>
</tr>
<tr>
<td>Data Transmission</td>
<td width="900">Wikibooks<br>Personal Experiments</td>
<td>https://en.wikibooks.org/wiki/Communication_Networks/TCP_and_UDP_Protocols<br>Refer To Testing
Section
</td>
</tr>
<tr>
<td>Set Manipulation</td>
<td width="900">Wikibooks<br>MSDN Docs</td>
<td>https://msdn.microsoft.com/en-us/library/xfhwa508(v=vs.110).aspx</td>
</tr>
<tr>
<td>Efficiency</td>
<td width="900">Concurrency in C# Cookbook</td>
<td>http://stephencleary.com/book/</td>
</tr>
<tr>
<td>Chart Generation</td>
<td width="900">Personal Experiments</td>
<td>Refer To Testing Section</td>
</tr>
</tbody>
</table>
</p>
</section>
</div>
</div>
<div id="sidebar1"></div>
</div>
</body>
</html>