microsoft/AI-For-Beginners

Public

mirrored fromhttps://github.com/microsoft/AI-For-BeginnersAvailable

CodeCommitsIssuesPull requestsActionsInsightsSecurity
5548ea189b32d46e643114dac9b137c56eda0236

Branches

Tags

  • No tags available.
0Branches0Tags
Go to file
Add file
Code

Clone

HTTPS

Download ZIP

lessons/3-NeuralNetworks/05-Frameworks/IntroPyTorch.ipynb

12231lines · modecode

1{
2 "cells": [
3 {
4 "cell_type": "markdown",
5 "metadata": {
6 "id": "En2vX4FuwHlu"
7 },
8 "source": [
9 "## Introduction to PyTorch\n",
10 "\n",
11 "> This notebook is a part of [AI for Beginners Curricula](http://github.com/microsoft/ai-for-beginners). Visit the repository for complete set of learning materials.\n",
12 "\n",
13 "### Neural Frameworks\n",
14 "\n",
15 "We have learnt that to train neural networks you need:\n",
16 "* Quickly multiply matrices (tensors)\n",
17 "* Compute gradients to perform gradient descent optimization\n",
18 "\n",
19 "What neural network frameworks allow you to do:\n",
20 "* Operate with tensors on whatever compute is available, CPU or GPU, or even TPU\n",
21 "* Automatically compute gradients (they are explicitly programmed for all built-in tensor functions)\n",
22 "\n",
23 "Optionally:\n",
24 "* Neural Network constructor / higher level API (describe network as a sequence of layers)\n",
25 "* Simple training functions (`fit`, as in Scikit Learn)\n",
26 "* A number of optimization algorithms in addition to gradient descent\n",
27 "* Data handling abstractions (that will ideally work on GPU, too)"
28 ]
29 },
30 {
31 "cell_type": "markdown",
32 "metadata": {
33 "id": "8cACQoFMwHl3"
34 },
35 "source": [
36 "### Most Popular Frameworks\n",
37 "\n",
38 "* Tensorflow 1.x - first widely available framework (Google). Allowed to define static computation graph, push it to GPU, and explicitly evaluate it\n",
39 "* PyTorch - a framework from Facebook that is growing in popularity\n",
40 "* Keras - higher level API on top of Tensorflow/PyTorch to unify and simplify using neural networks (Francois Chollet)\n",
41 "* Tensorflow 2.x + Keras - new version of Tensorflow with integrated Keras functionality, which supports **dynamic computation graph**, allowing to perform tensor operations very similar to numpy (and PyTorch)\n",
42 "\n",
43 "In this Notebook, we will learn to use PyTorch. You need to make sure that you have recent version of PyTorch installed - to do it, follow the [instructions on their site](https://pytorch.org/get-started/locally/). It is normally as simple as doing\n",
44 "```\n",
45 "pip install torch torchvision\n",
46 "```\n",
47 "or\n",
48 "```\n",
49 "conda install pytorch -c pytorch\n",
50 "```"
51 ]
52 },
53 {
54 "cell_type": "code",
55 "execution_count": null,
56 "metadata": {
57 "colab": {
58 "base_uri": "https://localhost:8080/",
59 "height": 36
60 },
61 "id": "xwqVx9-bwHl3",
62 "outputId": "7fdf1bd8-a54b-4eb0-cb09-dbb81a42d99c",
63 "tags": []
64 },
65 "outputs": [
66 {
67 "output_type": "execute_result",
68 "data": {
69 "text/plain": [
70 "'1.11.0+cu113'"
71 ],
72 "application/vnd.google.colaboratory.intrinsic+json": {
73 "type": "string"
74 }
75 },
76 "metadata": {},
77 "execution_count": 10
78 }
79 ],
80 "source": [
81 "import torch\n",
82 "torch.__version__"
83 ]
84 },
85 {
86 "cell_type": "markdown",
87 "metadata": {
88 "id": "6tp2xGV7wHl4"
89 },
90 "source": [
91 "## Basic Concepts: Tensor\n",
92 "\n",
93 "**Tensor** is a multi-dimensional array. It is very convenient to use tensors to represent different types of data:\n",
94 "* 400x400 - black-and-white picture\n",
95 "* 400x400x3 - color picture \n",
96 "* 16x400x400x3 - minibatch of 16 color pictures\n",
97 "* 25x400x400x3 - one second of 25-fps video\n",
98 "* 8x25x400x400x3 - minibatch of 8 1-second videos"
99 ]
100 },
101 {
102 "cell_type": "markdown",
103 "metadata": {
104 "id": "qG2bsaR7wHl4"
105 },
106 "source": [
107 "### Simple Tensors\n",
108 "\n",
109 "You can easily create simple tensors from lists of np-arrays, or generate random ones:"
110 ]
111 },
112 {
113 "cell_type": "code",
114 "execution_count": null,
115 "metadata": {
116 "colab": {
117 "base_uri": "https://localhost:8080/"
118 },
119 "id": "ybpnk08HwHl4",
120 "outputId": "377e6e25-bc5a-4d2e-fe8e-17dac1d20c2c",
121 "trusted": true
122 },
123 "outputs": [
124 {
125 "output_type": "stream",
126 "name": "stdout",
127 "text": [
128 "tensor([[1, 2],\n",
129 " [3, 4]])\n",
130 "tensor([[ 0.8995, -1.6137, 1.4489],\n",
131 " [-0.2796, -2.1443, -2.4618],\n",
132 " [-0.2358, -0.4249, -0.0716],\n",
133 " [-0.1267, -0.6382, 0.0593],\n",
134 " [-0.4956, 1.7054, 0.3874],\n",
135 " [ 1.3479, -1.6329, 0.2793],\n",
136 " [ 1.1211, -1.5430, 0.7186],\n",
137 " [-1.5197, 0.5559, -1.6421],\n",
138 " [ 0.1900, -0.4175, -0.3922],\n",
139 " [ 1.8994, 0.1497, -0.7039]])\n"
140 ]
141 }
142 ],
143 "source": [
144 "a = torch.tensor([[1,2],[3,4]])\n",
145 "print(a)\n",
146 "a = torch.randn(size=(10,3))\n",
147 "print(a)"
148 ]
149 },
150 {
151 "cell_type": "markdown",
152 "metadata": {
153 "id": "AXFMsV3r09Ux"
154 },
155 "source": [
156 "You can use arithmetic operations on tensors, which are performed element-wise, as in numpy. Tensors are automatically expanded to required dimension, if needed. To extract numpy-array from tensor, use `.numpy()`:"
157 ]
158 },
159 {
160 "cell_type": "code",
161 "execution_count": null,
162 "metadata": {
163 "colab": {
164 "base_uri": "https://localhost:8080/"
165 },
166 "id": "e5Nu5Xgj1DnQ",
167 "outputId": "c1fbcd86-dde6-40b6-8edf-7a37f9d60901"
168 },
169 "outputs": [
170 {
171 "name": "stdout",
172 "output_type": "stream",
173 "text": [
174 "tensor([[ 0.0000, 0.0000, 0.0000],\n",
175 " [-2.0583, -0.5631, 1.4932],\n",
176 " [-1.0613, -1.0738, 2.2078],\n",
177 " [-1.5101, 0.5896, 2.4722],\n",
178 " [-2.8219, -2.0846, 1.2405],\n",
179 " [ 0.8706, -0.2485, 2.3679],\n",
180 " [-1.6590, 0.1935, 1.8698],\n",
181 " [-0.3316, 0.8065, 1.6490],\n",
182 " [-1.5788, -1.1844, -0.4816],\n",
183 " [ 0.0680, -1.4526, 1.8159]])\n",
184 "[3.887189 2.1276016 0.17371987]\n"
185 ]
186 }
187 ],
188 "source": [
189 "print(a-a[0])\n",
190 "print(torch.exp(a)[0].numpy())"
191 ]
192 },
193 {
194 "cell_type": "markdown",
195 "metadata": {
196 "id": "uQ5zN6cVyrG7"
197 },
198 "source": [
199 "## In-place and out-of-place Operations\n",
200 "\n",
201 "Tensor operations such as `+`/`add` return new tensors. However, sometimes you need to modify the existing tensor in-place. Most of the operations have their in-place counterparts, which end with `_`:"
202 ]
203 },
204 {
205 "cell_type": "code",
206 "execution_count": null,
207 "metadata": {
208 "colab": {
209 "base_uri": "https://localhost:8080/"
210 },
211 "id": "Mjkbcw3-ACKS",
212 "outputId": "ca021008-9ab6-4b09-c5a5-bbe854cd1493"
213 },
214 "outputs": [
215 {
216 "name": "stdout",
217 "output_type": "stream",
218 "text": [
219 "Result when adding out-of-place: tensor(8)\n",
220 "Result after adding in-place: tensor(8)\n"
221 ]
222 }
223 ],
224 "source": [
225 "u = torch.tensor(5)\n",
226 "print(\"Result when adding out-of-place:\",u.add(torch.tensor(3)))\n",
227 "u.add_(torch.tensor(3))\n",
228 "print(\"Result after adding in-place:\", u)"
229 ]
230 },
231 {
232 "cell_type": "markdown",
233 "metadata": {
234 "id": "DLPUcVsXACKT"
235 },
236 "source": [
237 "This is how we can compute the sum or all rows in a matrix in a naive way:"
238 ]
239 },
240 {
241 "cell_type": "code",
242 "execution_count": null,
243 "metadata": {
244 "colab": {
245 "base_uri": "https://localhost:8080/"
246 },
247 "id": "7pu0UZ-_yqfB",
248 "outputId": "bd2e8c6a-39e1-4f29-990b-9591e866936c"
249 },
250 "outputs": [
251 {
252 "name": "stdout",
253 "output_type": "stream",
254 "text": [
255 "tensor([ 3.4945, 2.5325, -2.8684])\n"
256 ]
257 }
258 ],
259 "source": [
260 "s = torch.zeros_like(a[0])\n",
261 "for i in a:\n",
262 " s.add_(i)\n",
263 "\n",
264 "print(s)"
265 ]
266 },
267 {
268 "cell_type": "markdown",
269 "metadata": {
270 "id": "rIh1EHcezlNo"
271 },
272 "source": [
273 "But it is much better to use"
274 ]
275 },
276 {
277 "cell_type": "code",
278 "execution_count": null,
279 "metadata": {
280 "colab": {
281 "base_uri": "https://localhost:8080/"
282 },
283 "id": "aQIdWZ1kzn6P",
284 "outputId": "89000bb4-f45e-493b-a7b0-39fa4e7d92c1"
285 },
286 "outputs": [
287 {
288 "data": {
289 "text/plain": [
290 "tensor([ 3.4945, 2.5325, -2.8684])"
291 ]
292 },
293 "execution_count": 6,
294 "metadata": {},
295 "output_type": "execute_result"
296 }
297 ],
298 "source": [
299 "torch.sum(a,axis=0)"
300 ]
301 },
302 {
303 "cell_type": "markdown",
304 "metadata": {
305 "id": "5UzUmEZhACKT"
306 },
307 "source": [
308 "You can read more on PyTorch tensors in the [official documentation](https://pytorch.org/tutorials/beginner/basics/tensorqs_tutorial.html)"
309 ]
310 },
311 {
312 "cell_type": "markdown",
313 "metadata": {
314 "id": "U-auwezDwHl6"
315 },
316 "source": [
317 "## Computing Gradients\n",
318 "\n",
319 "For back propagation, you need to compute gradients. We can set any PyTorch Tensor's attribute `requires_grad` to `True`, which will result in all operations with this tensor being tracked for gradient calculations. To compute the gradients, you need to call `backward()` method, after which the gradient will become available using `grad` attribute:\n"
320 ]
321 },
322 {
323 "cell_type": "code",
324 "execution_count": null,
325 "metadata": {
326 "colab": {
327 "base_uri": "https://localhost:8080/"
328 },
329 "id": "m8vFOXr7wHl6",
330 "outputId": "7054c2b1-0b61-4938-937d-813f75f0b195",
331 "trusted": true
332 },
333 "outputs": [
334 {
335 "name": "stdout",
336 "output_type": "stream",
337 "text": [
338 "tensor([[-0.1728, 0.0913],\n",
339 " [-0.1666, -0.1942]])\n"
340 ]
341 }
342 ],
343 "source": [
344 "a = torch.randn(size=(2, 2), requires_grad=True)\n",
345 "b = torch.randn(size=(2, 2))\n",
346 "\n",
347 "c = torch.mean(torch.sqrt(torch.square(a) + torch.square(b))) # Do some math using `a`\n",
348 "c.backward() # call backward() to compute all gradients\n",
349 "# What's the gradient of `c` with respect to `a`?\n",
350 "print(a.grad)"
351 ]
352 },
353 {
354 "cell_type": "markdown",
355 "metadata": {
356 "id": "nPj3rtrtACKU"
357 },
358 "source": [
359 "To be more precise, PyTorch automatically **accumulates** gradients. If you specify `retain_graph=True` when calling `backward`, computational graph will be preserved, and new gradient is added to the `grad` field. In order to restart computing gradients from scratch, we need to reset `grad` field to 0 explicitly by calling `zero_()`: "
360 ]
361 },
362 {
363 "cell_type": "code",
364 "execution_count": null,
365 "metadata": {
366 "colab": {
367 "base_uri": "https://localhost:8080/"
368 },
369 "id": "z_VIw8MoACKU",
370 "outputId": "36a28b11-6919-47ab-c3f9-c7f1d8500423"
371 },
372 "outputs": [
373 {
374 "name": "stdout",
375 "output_type": "stream",
376 "text": [
377 "tensor([[-0.5185, 0.2739],\n",
378 " [-0.4998, -0.5826]])\n",
379 "tensor([[-0.1728, 0.0913],\n",
380 " [-0.1666, -0.1942]])\n"
381 ]
382 }
383 ],
384 "source": [
385 "c = torch.mean(torch.sqrt(torch.square(a) + torch.square(b)))\n",
386 "c.backward(retain_graph=True)\n",
387 "c.backward(retain_graph=True)\n",
388 "print(a.grad)\n",
389 "a.grad.zero_()\n",
390 "c.backward()\n",
391 "print(a.grad)"
392 ]
393 },
394 {
395 "cell_type": "markdown",
396 "metadata": {
397 "id": "HM9sUkVgCiG9"
398 },
399 "source": [
400 "To compute gradients, PyTorch creates and maintains **compute graph**. For each tensor that has the `requires_grad` flag set to `True`, PyTorch maintains a special function called `grad_fn`, which computes the derivative of the expression according to chain differentiation rule:"
401 ]
402 },
403 {
404 "cell_type": "code",
405 "execution_count": null,
406 "metadata": {
407 "colab": {
408 "base_uri": "https://localhost:8080/"
409 },
410 "id": "PcxHb-7jC7Vv",
411 "outputId": "3b3fa138-6d09-4636-8a71-f4a4051c7827"
412 },
413 "outputs": [
414 {
415 "name": "stdout",
416 "output_type": "stream",
417 "text": [
418 "tensor(0.9143, grad_fn=<MeanBackward0>)\n"
419 ]
420 }
421 ],
422 "source": [
423 "print(c)"
424 ]
425 },
426 {
427 "cell_type": "markdown",
428 "metadata": {
429 "id": "rvLfNiblACKV"
430 },
431 "source": [
432 "Here `c` is computed using `mean` function, thus `grad_fn` point to a function called `MeanBackward`.\n",
433 "\n",
434 "In most of the cases, we want PyTorch to compute gradient of a scalar function (such as loss function). However, if we want to compute the gradient of a tensor with respect to another tensor, PyTorch allows us to compute the product of a Jacobian matrix and a given vector.\n",
435 "\n",
436 "Suppose we have a vector function $\\vec{y}=f(\\vec{x})$, where\n",
437 "$\\vec{x}=\\langle x_1,\\dots,x_n\\rangle$ and\n",
438 "$\\vec{y}=\\langle y_1,\\dots,y_m\\rangle$, then a gradient of $\\vec{y}$ with respect to $\\vec{x}$ is defined by a **Jacobian**:\n",
439 "\n",
440 "$$\n",
441 "\\begin{align}J=\\left(\\begin{array}{ccc}\n",
442 " \\frac{\\partial y_{1}}{\\partial x_{1}} & \\cdots & \\frac{\\partial y_{1}}{\\partial x_{n}}\\\\\n",
443 " \\vdots & \\ddots & \\vdots\\\\\n",
444 " \\frac{\\partial y_{m}}{\\partial x_{1}} & \\cdots & \\frac{\\partial y_{m}}{\\partial x_{n}}\n",
445 "\\end{array}\\right)\\end{align}\n",
446 "$$\n",
447 "\n",
448 "Instead of giving us access to the whole Jacobian, PyTorch computes the product $v^T\\cdot J$ of Jacobian with some vector\n",
449 "$v=(v_1 \\dots v_m)$. In order to do that, we need to call ``backward`` and pass `v` as an argument. The size of `v` should be the same as the size of the original tensor, with respect to which we compute the gradient.\n"
450 ]
451 },
452 {
453 "cell_type": "code",
454 "execution_count": null,
455 "metadata": {
456 "colab": {
457 "base_uri": "https://localhost:8080/"
458 },
459 "id": "VUNYiQCOACKV",
460 "outputId": "e3127c21-fce6-420d-f347-ec40cc827e7e"
461 },
462 "outputs": [
463 {
464 "name": "stdout",
465 "output_type": "stream",
466 "text": [
467 "tensor([[-0.8642, 0.0913],\n",
468 " [-0.1666, -0.9710]])\n"
469 ]
470 }
471 ],
472 "source": [
473 "c = torch.sqrt(torch.square(a) + torch.square(b))\n",
474 "c.backward(torch.eye(2)) # eye(2) means 2x2 identity matrix\n",
475 "print(a.grad)"
476 ]
477 },
478 {
479 "cell_type": "markdown",
480 "metadata": {
481 "id": "dGHlkVlvACKV"
482 },
483 "source": [
484 "More on computing Jacobians in PyTorch can be found in [official documentation](https://pytorch.org/tutorials/beginner/basics/autogradqs_tutorial.html)"
485 ]
486 },
487 {
488 "cell_type": "markdown",
489 "metadata": {
490 "id": "FnVvj4LkD15r"
491 },
492 "source": [
493 "# Example 0: Optimization Using Gradient Descent\n",
494 "\n",
495 "Let's try to use automatic differentiation to find a minimum of a simple two-variable function $f(x_1,x_2)=(x_1-3)^2+(x_2+2)^2$. Let tensor `x` hold the current coordinates of a point. We start with some starting point $x^{(0)}=(0,0)$, and compute the next point in a sequence using gradient descent formula:\n",
496 "$$\n",
497 "x^{(n+1)} = x^{(n)} - \\eta\\nabla f\n",
498 "$$\n",
499 "Here $\\eta$ is so-called **learning rage** (we will denote it by `lr` in the code), and $\\nabla f = (\\frac{\\partial f}{\\partial x_1},\\frac{\\partial f}{\\partial x_2})$ - gradient of $f$.\n",
500 "\n",
501 "To begin, let's define starting value of `x` and the function `f`:"
502 ]
503 },
504 {
505 "cell_type": "code",
506 "execution_count": null,
507 "metadata": {
508 "id": "nDw5mV9KEeOa"
509 },
510 "outputs": [],
511 "source": [
512 "x = torch.zeros(2,requires_grad=True)\n",
513 "f = lambda x : (x-torch.tensor([3,-2])).pow(2).sum()\n",
514 "lr = 0.1"
515 ]
516 },
517 {
518 "cell_type": "markdown",
519 "metadata": {
520 "id": "Wt815LWdEj77"
521 },
522 "source": [
523 "Now let's do 15 iterations of gradient descent. In each iteration, we will update `x` coordinates and print them, to make sure that we are approaching the minimum point at (3,-2):"
524 ]
525 },
526 {
527 "cell_type": "code",
528 "execution_count": null,
529 "metadata": {
530 "colab": {
531 "base_uri": "https://localhost:8080/"
532 },
533 "id": "KfwMf555EyWJ",
534 "outputId": "67e2199c-61ff-4ad1-9c48-b4a646bf8bbd"
535 },
536 "outputs": [
537 {
538 "name": "stdout",
539 "output_type": "stream",
540 "text": [
541 "Step 0: x[0]=0.6000000238418579, x[1]=-0.4000000059604645\n",
542 "Step 1: x[0]=1.0800000429153442, x[1]=-0.7200000286102295\n",
543 "Step 2: x[0]=1.4639999866485596, x[1]=-0.9760000705718994\n",
544 "Step 3: x[0]=1.7711999416351318, x[1]=-1.1808000802993774\n",
545 "Step 4: x[0]=2.0169599056243896, x[1]=-1.3446400165557861\n",
546 "Step 5: x[0]=2.2135679721832275, x[1]=-1.4757120609283447\n",
547 "Step 6: x[0]=2.370854377746582, x[1]=-1.5805696249008179\n",
548 "Step 7: x[0]=2.4966835975646973, x[1]=-1.6644556522369385\n",
549 "Step 8: x[0]=2.597346782684326, x[1]=-1.7315645217895508\n",
550 "Step 9: x[0]=2.677877426147461, x[1]=-1.7852516174316406\n",
551 "Step 10: x[0]=2.7423019409179688, x[1]=-1.8282012939453125\n",
552 "Step 11: x[0]=2.793841600418091, x[1]=-1.8625609874725342\n",
553 "Step 12: x[0]=2.835073232650757, x[1]=-1.8900487422943115\n",
554 "Step 13: x[0]=2.868058681488037, x[1]=-1.912039041519165\n",
555 "Step 14: x[0]=2.894446849822998, x[1]=-1.929631233215332\n"
556 ]
557 }
558 ],
559 "source": [
560 "for i in range(15):\n",
561 " y = f(x)\n",
562 " y.backward()\n",
563 " gr = x.grad\n",
564 " x.data.add_(-lr*gr)\n",
565 " x.grad.zero_()\n",
566 " print(\"Step {}: x[0]={}, x[1]={}\".format(i,x[0],x[1]))"
567 ]
568 },
569 {
570 "cell_type": "markdown",
571 "metadata": {
572 "id": "8sfjBMBu59B5"
573 },
574 "source": [
575 "## Example 1: Linear Regression\n",
576 "\n",
577 "Now we know enough to solve the classical problem of **Linear regression**. Let's generate small synthetic dataset:"
578 ]
579 },
580 {
581 "cell_type": "code",
582 "execution_count": null,
583 "metadata": {
584 "id": "j723455WwHl7",
585 "trusted": true
586 },
587 "outputs": [],
588 "source": [
589 "import numpy as np\n",
590 "import matplotlib.pyplot as plt\n",
591 "from sklearn.datasets import make_classification, make_regression\n",
592 "from sklearn.model_selection import train_test_split\n",
593 "import random"
594 ]
595 },
596 {
597 "cell_type": "code",
598 "execution_count": null,
599 "metadata": {
600 "colab": {
601 "base_uri": "https://localhost:8080/",
602 "height": 282
603 },
604 "id": "WJNK_J6v6I-Z",
605 "outputId": "09e6386e-a6d4-4b81-c8d2-153f0acf9696"
606 },
607 "outputs": [
608 {
609 "data": {
610 "text/plain": [
611 "<matplotlib.collections.PathCollection at 0x20b8e1f1ca0>"
612 ]
613 },
614 "execution_count": 14,
615 "metadata": {},
616 "output_type": "execute_result"
617 },
618 {
619 "data": {
620 "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWoAAAD4CAYAAADFAawfAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAAAbVklEQVR4nO3df4ylVXkH8O+zw0XuAjJaphVGx8XULKkQdtmJoZnGyGrFij82YNTGtKltsmmTNkIo7egfRf9iEmPVxqbNxNJqSnVpFzYGVDRZDHWj2Bl2EZClUXErs7aMZQfEmbqzw9M/7n2XO++85z3nve857z3n3u8n2bC795075903PPfMc57zHFFVEBFRvLYNegBERFSOgZqIKHIM1EREkWOgJiKKHAM1EVHkzgnxphdffLHu2LEjxFsTEQ2lxcXFn6nqRNFrQQL1jh07sLCwEOKtiYiGkoicML3G1AcRUeQYqImIIsdATUQUOQZqIqLIMVATEUUuSNUHEdEoOXR0CZ+4/0mcXFnDpeNt3HrdTuzbPent/RmoiYhqOHR0CR+5+1GsrW8AAJZW1vCRux8FAG/BmqkPIqIaPnH/k2eDdGZtfQOfuP9Jb9+DgZqIqIaTK2uV/r4fDNRERDVcOt6u9Pf9YKAmIkIn1zwzdxiXzd6HmbnDOHR0yenrbr1uJ9qtsU1/126N4dbrdnobGxcTiWjk1VkQzF5n1QcRUUBlC4IuAXff7kmvgTmPqQ8iGnlNLAjWYQ3UIrJTRI71/HpeRG5qYGxERI1oYkGwDmugVtUnVXWXqu4CsAfAKoB7Qg+MiKgpTSwI1lE1R/0WAD9UVWODayKi1FRZEOzdLn5RuwURYGV1PcgiYkZU1f1ikTsAPKyqny14bT+A/QAwNTW158QJxnIiGi756pC8dmsMt99wZV/BWkQWVXW66DXnxUQRORfAuwH8a9HrqjqvqtOqOj0xUXjsFxFR9MrqqYuqQ3r53jqeqZL6+B10ZtP/430UREQRsNVTu1SBhKgUqVKe97sAvuh9BEREkbA1WHKpAglRKeIUqEVkO4DfBnC39xEQEUXCVk9dVB3SK1SliFPqQ1VXAfyK9+9ORBSRS8fbWCoI1tksOV8d0lTVB7eQExF13Xrdzi1VHflZcujt4kUYqImIupposNQPBmoioh6DmDHbsCkTEVHkGKiJiCLHQE1EFDnmqIloJPQ2U4plkdAVAzURDYWyQNzvUVvZey6trGFMBBuqmBxAkGegJqJKYpyZlgViALjlrkewkesUajtqK/+e2ddXOU/Rl0ptTl1NT0/rwsKC9/closEqavNZp7WnLzNzhwt3FI63W/jlmRdLO95NjrcLP3RM79n7dUdm99YffJeXNqdERLamRYNi6tGxsrZeGqQFnRmy4qWZctbW1NYFr8nzFBmoichZrIfA9tOxTgDk8wlVOuU1eZ4iAzUROTMFp4vaLWOz/SaYzjx8xfZW4fVjIluCdMalU17T5ykyUBORs6Lg1dom+MXpM8YUQgj5U1gA4PYbrsTkeBuCTv749huuxG3vekNhAP/k+67CpOXk8X27J8++J9AJ7uh5b1Z9EFGUipoWrZ4+g1Or65uus1VU1GGq8Lj9hiuNi3umKpUYO+UVYdUHEdVy2ex9hWkEAfDU3PXev5+pGqOfKoyYSg3Lqj44oyaiWmzN9n3zuaAZy4zZhjlqIqrFtJAXarHN9AHQZBVG0xioiaiW3kW33oW8UDPVpj8YYsDUBxHV1mQKIdZTWEJyCtQiMg7gcwCuQKdG/A9V9dsBx0VEZJRKbtkX1xn1ZwB8TVXfKyLnAtgecExERIViqtJokjVQi8jLAbwJwB8AgKqeBnA67LCIiDbrt1XpMHBZTHwdgGUA/ygiR0XkcyJyfv4iEdkvIgsisrC8vOx9oEQ0WPndgE1vE4+1IVQTXAL1OQCuBvB3qrobwC8AzOYvUtV5VZ1W1emJiQnPwySiQcpms01uE+/93mUtRwfdEKoJLjnqpwE8raoPdf/8bygI1EQ0vEyz2Y99+fHSU1Xq5pOL+l/nDXP9dMYaqFX1v0XkJyKyU1WfBPAWAN8PPzQiikVZv+eVtU6fj/ypKj7yyUUfEL2GvX4641r18WcA7uxWfPwIwIfCDYmIYmPaJp7XmzM25ZOrBOqytMYgzi4cFKdArarHABQ2CyGi4XfrdTutKYhMWXCtmk82fUD4PgYrdtxCTkRWRdvETU35Lx1vO/XjcKkiGcXt4kW4hZyInOR3A5oOus2CaNlrLjXR2WLk2voGxkSwoTpS6Y5eDNREI6xOZYZLzw3Ta2U10ft2T24J5BuqZwP9qAVpgAcHEI0s04y4iWOmTIcNAJ20imnhsig3PSzbyssODmCOmmhEDXKnnymHLUBpdUl+MXKQG3GaxEBNNKJ8npRSVdEioQDGWXYmH+BHZVs5AzXRkDNVV5hmtQoE7+WRryIZb7esQbqo2mOQHzZN4mIi0RArq64oq4323ZnOlEfuXTgsY6r2aPq8xkFhoCYaQllgLApiWWogW5SzXVc3UNtK8cq2idsWN4s+bNqtMVx7+QRm5g4nv8CYYeqDyINBtwDNjyVbYDPJUgP7dk/iyOxeiOW6Omx55LLvYatAKdqIc+OeSRxcXBqqBUbOqIlqiq2hva2REbA1NeAzhZBPc9jak5ZtE3f598tvxJmZO+ylz0hMOKMmqmkQlQdlM3jbLLhoUc7XVu2icjnTbD37EPC9TdxlgTGmn4BccEZNVFPTlQe2GXzZLHZMZNOHSDbD9HWyd9GHlqK49G719BkcOrrk/VRx208Hsf0E5IKBmqimpisPbNuvixbYWtsEEGB9oxMui4KTj5O9TR9Oik4JXta7GgBOra5vGoOvIGlaYMxm6LZ/vxgx9UFUU9Md3mwz+KIFtgvOO+dskM6Y0jN10gKmD6fJ8TbOf9nWeWGIFFHR/fcuSqZYe80ZNVFNvn90t3GZwednqJfN3lf4XqYt2f2mBcpmszcfOOY0Bh/KZugp1l5zRk3kQVbm9tTc9Tgyuzfoj9D9zOBd+kMD9RdGy2azrmMILcUe15xREyWmnxm8LW+b8ZEWMM1mXccQWtM/AfnAQE2UoKqLb67BKWRaIKYA6XPxsgnsR00UqUH0WR5kj+pRV9aPmjNqoggNqtY3plkvvcQpUIvIjwH8HMAGgDOmqE9Efgyy1je1tMAoqDKjvlZVfxZsJER0Voq1vhQOUx9EEcjno8e3t3BqdX3LdTHX+lI4rnXUCuDrIrIoIvuLLhCR/SKyICILy8vL/kZINOSKGhm98H9n0Brb3M4o9lpfCsd1Rj2jqidF5FcBfENEjqvqg70XqOo8gHmgU/XheZxEQyM/e149fWZLPnr9RcV4u4XzX3YOF/XILVCr6snuf58RkXsAvBHAg+VfRUR5RdUcJs+trePYbW9ramgUMWvqQ0TOF5ELs98DeBuAx0IPjGgYuTT1zzAfTRmXGfWvAbhHRLLr/0VVvxZ0VERDyrVqg/lo6mUN1Kr6IwBXNTAWoqFn2qLNfDSVYXkeJWkQ26t9MDUm+ti732Acf++9XtRuQQRYWV1P6r6pHgZqSk6T26ttHwhVPzCqbtHO32vvCSlF953qBxiVY1MmSs7M3GHjqdVHZvd6+z62BkVNNDAy3Wuv7L7ZUCltZU2ZeHAAJaep7dW2JvpNnD7uck/ZNYM4DZ2awUBNyWnqpBDbB0ITHxgu95Rdw/4gw4uBmpLT1FFKtg+EJj4wiu61V+99x3LUFfnHQE3JsZ0y7YvtA6GJD4z8vY63W3jF9lbhfYcYT50TyckfLiYSlfBd9THo8VZ9Ly5ONqdsMZGBmihxoT4smqquoQ4exUWUiKpBN2RNORcn48EcNVHOoPKyRX2pP3L3o6XfP2RJHhcn48FATUkJHUT7CZau72sbdz9BN+Sst6nqGrJjoKZkhAqivULMUF3H3U/QDTnrbaq6huyYo6ZkNHEyd4gZquu4TZ31yoKuqcmTr1kvTySPAwM1JaOpnYBVg6WNaXxLK2uYmTt8duHw2ssncHBxqVLQrdrkidLEQE3JCBFE80LMUE3jFrx0FNfSyhoOLi7hxj2TeOD4cqWgy1nv8GOgpmSE/jEfKJ+h9luvXDRuAZDfwbC2voEHji83UqMc20YdKscNL5SUQQWYol16APCK7S3c9q7ipv9lDf9NrUsFwFNz14e4hU3j4o7D+HDDCw0N24/5oQK56VDaU6vrhRtMihr+t1tj+NT7d2Hf7knjrr8mapSbWJQlv1ieR17E0LwnZPle2YJlUfmercxvkDXK3HGYHudALSJjInJURO4NOSBKTxP1zS5MwfGWux6pPRbbTDcf5GzBcJA1ytxxmJ4qqY8PA3gCwMsDjYUSFcuP0qbguKFau/9F0YJgr94gd+joEraJYKNg/af3ukFVazSxKEt+Oc2oReTVAK4H8Lmww6EUxfKjdNmMsO7uwmwGPN5ubXmtN8hlP10UBelYgiF3HKbHdUb9aQB/AeBC0wUish/AfgCYmpqqPTBKRxP1zS5ss966HxzZDLhswdK06DgmElUwZO11WqyBWkTeCeAZVV0UkTebrlPVeQDzQKc8z9cAKX6x/CidBZ5b7nrEmnao+31MQc70YfCiKgMj9c0l9TED4N0i8mMAXwKwV0T+OeioKCkx/Si9b/ckPvm+qwZWUcGFOgqh0oaX7oz6z1X1nWXXccMLDVpMG2O4mYRccMMLjZxB5WDZJIlC4BZyGphB9ptgrwuKDWfUFB2fZ/35Omdw4cSzlTvXETWBM2oaCFOvC6CzGOkaJKvkhLOAXtYQqff/BuaWqUllM2r2+qCBKKtprrIF3eXorENHl7Dr41/HTQeOGYM0UNx21MchsUR1MVDTQNjK1VyDpG1XZDbjXllbrz7IkvcnahIDNTnz2SGvqHtcnkuQtNUtm3YK5knF9ydqEgM1OfHdIa93k4yJS5C0tQt1CfaT42188JqpgW2SIbJh1Qc5CdEhr7d3Rr9b0G11y2WnqeQXC6df+0qW7FGUGKjJScgOeXU3iZRtbjE1aio6QouNiihWDNRDoInNG6E75IUKktwpSMOAgTpxPjeOlImlQ14/OFOm1HExMXEudcQ+xNQhj2jUcEaduCZPV2liZtqbxrmo3YJI56Tvse7RVlV2LRINCwbqxMVyuoqNSx49n8bp3aSSHQQQKrVDFDOmPhJnqyOOgWsNtuvmFG7tplHDQJ24FHLHpjz6TQeObdrhWCVdw63dNEqY+hgCsVc1uDRgAso3p+TFltohComBmrzL56PHt7dwatXcFClLZdhOEc/EltohCo2BmrwqqutubRO0xgTrG+be5ydX1rZsTmHVB1EHAzV5VZSPXn9RMd5u4fyXnWNMbWSpjKbTODySi1LAxUTyypSPfm5tHUdm9+LT798VTZWK746ARKFYA7WInCci3xWRR0TkcRH5eBMDo5f47AMdmq0/dExVKk3t6iSqyyX18UsAe1X1BRFpAfiWiHxVVb8TeGyE5np5+OLSEySWKpUmd3US1WEN1No5/faF7h9b3V/+T8SlQj77QDeRj02pW10quzqJnE4hF5ExAIsAfh3A36rqXxZcsx/AfgCYmprac+LECc9DHU2Xzd5X+KkoAJ6au975fYqa82enbhdVUozCIluVE8yJQis7hdyp6kNVNwDsEpFxAPeIyBWq+ljumnkA8wAwPT3NGbcnvmZ9RTPz7CHl0ym2dEtR46SV1fXkAnpKs38abZXK81R1RUS+CeDtAB6zXD60mpxt+uoDbcu79qZTbItspsZJsefPi8SSLycq41L1MdGdSUNE2gDeCuB44HFFq+mSLl9VEi4z8CyYly2y2RonsWqCyD+XGfUlAD7fzVNvA3CXqt4bdljxCnHIq42PWZ/L9uwsmJvSLdtEnHpxsGqCyC+Xqo/vAdjdwFiSkGJJV5aqWVvfOLsVO1tIzPSmU0xBvejrimQBfxQWJImawJ2JFdk2dMSmN1UDdIJtuzWGD14zZUynZOmWMZEt76foVIuYZAGfu/6I/GGvj4piOuTVZcZqStU8cHwZR2b3Gt973+5J3HzgWOFrWUlfWdXHzNzhxlNERMOKgbqiWEq6XHcs1knVmHLVk+Pt0iBf9/sS0WYM1H2IoaTLdVGzTh12nZ8euOuPyB/mqAML1VDJdcZa50zFOqWBKZzlSJQKzqgDCtlQyXXGWjdV0+9PD7GkiIiGgVOvj6qmp6d1YWHB+/umZmbucGEwHRPBJ993Va2gxT4VRMOldq8P6o8pPbGhWntmzRkr0ehgoA6o7FRtH6Vqvhc1uUGFKE5cTAyoaEGtV0ylatygQhQvBuqAynb4AXGVqvFYKqJ4MfURWJY6aHo3Y9U0BjeoEMWLgboBLgt/PvPD/ZQFcoMKUbwYqBtStvDnu966n1asMfUwIaLNmKOOgM/88KGjS8ZKk7I0hq8DCojIP86oI+ArP5zNzE1saYwYepgQ0VacUUfAV4/rsmOymMYgShdn1DX5WAQ05YevvXwCM3OHa1duAGAagyhhDNQ1+FoELKoKufbyCRxcXPJSuTE53maQJkrY0AbqujPdOqenuG4NL/se/ZyQwsoNouFkDdQi8hoAXwDwKgAvAphX1c+EHlgddWe6TZyeYvse/bx3P42a2N+DKH4uM+ozAG5R1YdF5EIAiyLyDVX9fuCx9a3uTLeJ01Ns36Pf965SuRGyXzYR+WOt+lDVn6rqw93f/xzAEwCi/r+4brlbE6en2L5HEyeksL8HURoqleeJyA4AuwE8VPDafhFZEJGF5eVlT8PrT91yN9evr7NJxPY9mtiAwv4eRGlwXkwUkQsAHARwk6o+n39dVecBzAOdE168jdBBPs+ar5gAqs1GqyzK9btJxOV7hN6Awv4eRGlwmlGLSAudIH2nqt4ddkjVFPVRPri4hBv3TPY9G+1nNlv1ENsYtmzzAFqiNFjPTBQRAfB5AM+q6k0ub9rkmYmmcwknx9s4Mru39vu7VEWkfH4hqz6I4lB2ZqJLoP4tAP8O4FF0yvMA4KOq+hXT14QM1PnAYmpAJACemru+8vv1BqqiACwAFJ0Pguza0B8WRDT8ah1uq6rfQic+DVxROVkWOPNc8qy28rSiqojse/Vey0U5IgopqaZMpsCZ/xRxzbPaytNsgTa71ldTJSKiIkkFalPgzFIRAmC83cJ5rW24+cAx66KebSbsEmhPrqxxUY6IgkoqUJsCZ5YL/tT7d+GXZ17EqdV1p5O0bTNh2yni2bUxVHAQ0fBKqimTrfa46tZx2/v19s4oyofnr2VgJqIQkgrUtqZDVRf1XJoY9QbgGErZYhgDETXLWp7XjybrqHsNe5lcyvXaRFSurDwvqRy1TSqLelV3MWbYRIloNCWV+rDppx9z0+q0FmW9NtFoSjpQm/K1/QZmX/nfsvep0yubTZSIRlOygdp303tf71f35JayIM+jtohGU7I5at/5Wl/vZ3ufstrtok6AvXXgrNcmGk3Rzahd0w++87W+3s/l5BbTrNglLcJ6baLRE1WgNqUNFk48iweOL28K3r7ztb7ez/Y+ZQueNx84VvieXCwkGm1RBWrTjPLO7/zXlq51N+6ZrHWKS56v/G+dk1u4WEhERaLKUZc1Xeq1tr6BB44ve83X+sr/1nmfVOrAiahZUe1MNO0sLOJ6MEBquEWcaDTVOjigSUVpgzoHA6SIi4VElBdV6qMobfDBa6aYDiCikRbVjBoonlFOv/aVTAcQ0ciKLlAXYTqAiEaZNVCLyB0A3gngGVW9IvyQwuFCHRGlyGVG/U8APgvgC2GHspXPwOq7NwgRUVOsi4mq+iCAZxsYyya2vhdVsZczEaUqqqqPXr4DK3s5E1GqvAVqEdkvIgsisrC8vFz7/XwHVtuJ40REsfIWqFV1XlWnVXV6YmKi9vv5Dqzcnk1EqYo29eEzsGaLkmvrGxgTAQCMt1s4r7UNNx84VuncQiKiplkDtYh8EcC3AewUkadF5I/CD8tfk6TeRUkA2FBFa5vgF6fP4NTqupeFSiKikKJqyhRClUZPk+NtHJndG3hERERblTVlijb14UuVxUdWgBBRjIY+UFdZfGQFCBHFaOgDddGiZGuboDUmm/6OFSBEFKskmjLVYTqjsOjvuJWciGI09IuJREQpSOKEF3a2IyIqFkWgZmc7IiKzKBYT2dmOiMgsikDNznZERGZRBGp2tiMiMosiULOzHRGRWRSLiaZaZy4kEhFFEqgBnjRORGQSReqDiIjMGKiJiCLHQE1EFDkGaiKiyDFQExFFLkj3PBFZBnCizy+/GMDPPA5nkIblXoblPgDeS4yG5T6AevfyWlWdKHohSKCuQ0QWTK3+UjMs9zIs9wHwXmI0LPcBhLsXpj6IiCLHQE1EFLkYA/X8oAfg0bDcy7DcB8B7idGw3AcQ6F6iy1ETEdFmMc6oiYioBwM1EVHkBhKoReTtIvKkiPxARGYLXhcR+Zvu698TkasHMU4XDvfyZhF5TkSOdX/91SDGaSMid4jIMyLymOH1lJ6J7V5SeSavEZEHROQJEXlcRD5ccE0Sz8XxXlJ5LueJyHdF5JHuvXy84Bq/z0VVG/0FYAzADwG8DsC5AB4B8Bu5a94B4KsABMA1AB5qepwe7+XNAO4d9Fgd7uVNAK4G8Jjh9SSeieO9pPJMLgFwdff3FwL4z4T/X3G5l1SeiwC4oPv7FoCHAFwT8rkMYkb9RgA/UNUfqeppAF8C8J7cNe8B8AXt+A6AcRG5pOmBOnC5lySo6oMAni25JJVn4nIvSVDVn6rqw93f/xzAEwDyTduTeC6O95KE7r/1C90/trq/8lUZXp/LIAL1JICf9Pz5aWx9YC7XxMB1nL/Z/THpqyLyhmaG5l0qz8RVUs9ERHYA2I3O7K1Xcs+l5F6ARJ6LiIyJyDEAzwD4hqoGfS6DOOFFCv4u/2nkck0MXMb5MDp7+F8QkXcAOATg9aEHFkAqz8RFUs9ERC4AcBDATar6fP7lgi+J9rlY7iWZ56KqGwB2icg4gHtE5ApV7V0T8fpcBjGjfhrAa3r+/GoAJ/u4JgbWcarq89mPSar6FQAtEbm4uSF6k8ozsUrpmYhIC53Adqeq3l1wSTLPxXYvKT2XjKquAPgmgLfnXvL6XAYRqP8DwOtF5DIRORfABwB8OXfNlwH8fnfl9BoAz6nqT5seqAPrvYjIq0REur9/Izr/5v/b+EjrS+WZWKXyTLpj/AcAT6jqXxsuS+K5uNxLQs9lojuThoi0AbwVwPHcZV6fS+OpD1U9IyJ/CuB+dKom7lDVx0Xkj7uv/z2Ar6CzavoDAKsAPtT0OF043st7AfyJiJwBsAbgA9pdFo6JiHwRnVX3i0XkaQC3obNIktQzAZzuJYlnAmAGwO8BeLSbDwWAjwKYApJ7Li73kspzuQTA50VkDJ0Pk7tU9d6QMYxbyImIIsediUREkWOgJiKKHAM1EVHkGKiJiCLHQE1EFDkGaiKiyDFQExFF7v8B4SC4LI9GLoEAAAAASUVORK5CYII=",
621 "text/plain": [
622 "<Figure size 432x288 with 1 Axes>"
623 ]
624 },
625 "metadata": {
626 "needs_background": "light"
627 },
628 "output_type": "display_data"
629 }
630 ],
631 "source": [
632 "np.random.seed(13) # pick the seed for reproducibility - change it to explore the effects of random variations\n",
633 "\n",
634 "train_x = np.linspace(0, 3, 120)\n",
635 "train_labels = 2 * train_x + 0.9 + np.random.randn(*train_x.shape) * 0.5\n",
636 "\n",
637 "plt.scatter(train_x,train_labels)"
638 ]
639 },
640 {
641 "cell_type": "markdown",
642 "metadata": {
643 "id": "Ng4rZmGc6oxk"
644 },
645 "source": [
646 "Linear regression is defined by a straight line $f_{W,b}(x) = Wx+b$, where $W, b$ are model parameters that we need to find. An error on our dataset $\\{x_i,y_u\\}_{i=1}^N$ (also called **loss function**) can be defined as mean square error:\n",
647 "$$\n",
648 "\\mathcal{L}(W,b) = {1\\over N}\\sum_{i=1}^N (f_{W,b}(x_i)-y_i)^2\n",
649 "$$\n",
650 "\n",
651 "Let's define our model and loss function:"
652 ]
653 },
654 {
655 "cell_type": "code",
656 "execution_count": null,
657 "metadata": {
658 "id": "QxhI4GlB6aiH"
659 },
660 "outputs": [],
661 "source": [
662 "input_dim = 1\n",
663 "output_dim = 1\n",
664 "learning_rate = 0.1\n",
665 "\n",
666 "# This is our weight matrix\n",
667 "w = torch.tensor([100.0],requires_grad=True,dtype=torch.float32)\n",
668 "# This is our bias vector\n",
669 "b = torch.zeros(size=(output_dim,),requires_grad=True)\n",
670 "\n",
671 "def f(x):\n",
672 " return torch.matmul(x,w) + b\n",
673 "\n",
674 "def compute_loss(labels, predictions):\n",
675 " return torch.mean(torch.square(labels - predictions))"
676 ]
677 },
678 {
679 "cell_type": "markdown",
680 "metadata": {
681 "id": "JUxwj3367gD2"
682 },
683 "source": [
684 "We will train the model on a series of minibatches. We will use gradient descent, adjusting model parameters using the following formulae:\n",
685 "$$\n",
686 "\\begin{array}{l}\n",
687 "W^{(n+1)}=W^{(n)}-\\eta\\frac{\\partial\\mathcal{L}}{\\partial W} \\\\\n",
688 "b^{(n+1)}=b^{(n)}-\\eta\\frac{\\partial\\mathcal{L}}{\\partial b} \\\\\n",
689 "\\end{array}\n",
690 "$$"
691 ]
692 },
693 {
694 "cell_type": "code",
695 "execution_count": null,
696 "metadata": {
697 "id": "-991PErM7fJU"
698 },
699 "outputs": [],
700 "source": [
701 "def train_on_batch(x, y):\n",
702 " predictions = f(x)\n",
703 " loss = compute_loss(y, predictions)\n",
704 " loss.backward()\n",
705 " w.data.sub_(learning_rate * w.grad)\n",
706 " b.data.sub_(learning_rate * b.grad)\n",
707 " w.grad.zero_()\n",
708 " b.grad.zero_()\n",
709 " return loss"
710 ]
711 },
712 {
713 "cell_type": "markdown",
714 "metadata": {
715 "id": "idr2VEWb9rr0"
716 },
717 "source": [
718 "Let's do the training. We will do several passes through the dataset (so-called **epochs**), divide it into minibatches and call the function defined above:"
719 ]
720 },
721 {
722 "cell_type": "code",
723 "execution_count": null,
724 "metadata": {
725 "id": "nOuu0qpx-wAp"
726 },
727 "outputs": [],
728 "source": [
729 "# Shuffle the data.\n",
730 "indices = np.random.permutation(len(train_x))\n",
731 "features = torch.tensor(train_x[indices],dtype=torch.float32)\n",
732 "labels = torch.tensor(train_labels[indices],dtype=torch.float32)"
733 ]
734 },
735 {
736 "cell_type": "code",
737 "execution_count": null,
738 "metadata": {
739 "colab": {
740 "base_uri": "https://localhost:8080/"
741 },
742 "id": "3zdIf6c_85Ht",
743 "outputId": "6520288c-da59-4a9f-c37e-cd99779c3073"
744 },
745 "outputs": [
746 {
747 "name": "stdout",
748 "output_type": "stream",
749 "text": [
750 "Epoch 0: last batch loss = 94.5247\n",
751 "Epoch 1: last batch loss = 9.3428\n",
752 "Epoch 2: last batch loss = 1.4166\n",
753 "Epoch 3: last batch loss = 0.5224\n",
754 "Epoch 4: last batch loss = 0.3807\n",
755 "Epoch 5: last batch loss = 0.3495\n",
756 "Epoch 6: last batch loss = 0.3413\n",
757 "Epoch 7: last batch loss = 0.3390\n",
758 "Epoch 8: last batch loss = 0.3384\n",
759 "Epoch 9: last batch loss = 0.3382\n"
760 ]
761 }
762 ],
763 "source": [
764 "batch_size = 4\n",
765 "for epoch in range(10):\n",
766 " for i in range(0,len(features),batch_size):\n",
767 " loss = train_on_batch(features[i:i+batch_size].view(-1,1),labels[i:i+batch_size])\n",
768 " print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
769 ]
770 },
771 {
772 "cell_type": "markdown",
773 "metadata": {
774 "id": "JPO9xs4bToPb"
775 },
776 "source": [
777 "We now have obtained optimized parameters $W$ and $b$. Note that their values are similar to the original values used when generating the dataset ($W=2, b=1$)"
778 ]
779 },
780 {
781 "cell_type": "code",
782 "execution_count": null,
783 "metadata": {
784 "colab": {
785 "base_uri": "https://localhost:8080/"
786 },
787 "id": "US6q0nCBD-LL",
788 "outputId": "c804b779-3231-4f6f-c854-032d211b2853"
789 },
790 "outputs": [
791 {
792 "data": {
793 "text/plain": [
794 "(tensor([1.8617], requires_grad=True), tensor([1.0711], requires_grad=True))"
795 ]
796 },
797 "execution_count": 19,
798 "metadata": {},
799 "output_type": "execute_result"
800 }
801 ],
802 "source": [
803 "w,b"
804 ]
805 },
806 {
807 "cell_type": "code",
808 "execution_count": null,
809 "metadata": {
810 "colab": {
811 "base_uri": "https://localhost:8080/",
812 "height": 282
813 },
814 "id": "_e6xRMZFDnyI",
815 "outputId": "79e6c360-265a-401d-ce39-8f211917a13d"
816 },
817 "outputs": [
818 {
819 "data": {
820 "text/plain": [
821 "[<matplotlib.lines.Line2D at 0x20b8e30a850>]"
822 ]
823 },
824 "execution_count": 20,
825 "metadata": {},
826 "output_type": "execute_result"
827 },
828 {
829 "data": {
830 "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWoAAAD4CAYAAADFAawfAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAAArG0lEQVR4nO3deXhU1f3H8fdJiBBBCSKLBBGUxQUEBK02rmhdQePSuvxcaq1YxSouSLQu4BpFpXWpihbBrW5IQEGpNoqIoobFFVFBUYMKFMMaIAnn98fNxGEyy53Mncm94fN6njwNmTt3zvU+/d4z53zP9xhrLSIi4l9Zjd0AERGJT4FaRMTnFKhFRHxOgVpExOcUqEVEfK5ZOk668847265du6bj1CIiTdLcuXNXWmvbRXstLYG6a9eulJWVpePUIiJNkjFmaazXNPQhIuJzCtQiIj6nQC0i4nMK1CIiPqdALSLic2nJ+hAR2ZaUzC9nzIxFLKuopFNeLiOO6UVh/3zPzq9ALSKSgpL55Vz70idUVtUAUF5RybUvfQLgWbDW0IeISArGzFhUF6RDKqtqGDNjkWefoUAtIpKCZRWVSf29IRSoRURS0CkvN6m/N4QCtYgIzlhzQXEp3YqmUVBcSsn8clfvG3FML3Jzsrf6W25ONiOO6eVZ2zSZKCLbvFQmBEOvK+tDRCSN4k0Iugm4hf3zPQ3MkTT0ISLbvExMCKYiYaA2xvQyxiwI+1ljjBmegbaJiGREJiYEU5EwUFtrF1lr+1lr+wEDgA3A5HQ3TEQkUzIxIZiKZMeojwQWW2tjFrgWEQmaZCYEw5eLt87NwRio2FCVlknEEGOtdX+wMeOBedbaB6K8NhQYCtClS5cBS5cqlotI0xKZHRIpNyebO07p06BgbYyZa60dGO0115OJxpjtgBOBF6K9bq0dZ60daK0d2K5d1G2/RER8L14+dbTskHBeLx0PSWbo4zic3vTPnrdCRMQHEuVTu8kCSUemSDLpeWcC//a8BSIiPpGowJKbLJB0ZIq4CtTGmO2B3wEved4CERGfSJRPHS07JFy6MkVcDX1YazcAbT3/dBERH+mUl0t5lGAd6iVHZodkKutDS8hFRGqNOKZXvayOyF5yupeLR6NALSJSKxMFlhpCgVpEJExj9JgTUVEmEREvzJsHjzySllMrUIuIpOLrr+GMM2DAABg9GjZs8PwjFKhFRBrip59g2DDYay94+WW4/npYuBC2397zj9IYtYhsE8KLKaU0SbhmDYwZA2PHwqZNcOGFcOON0LGj942upUAtIk1CvEDc0K22Qucsr6gkt6aaM+dN46/vP0+b9avh9NPh1luhe/e0X5sCtYgkxbOeqcdtihWIAa56/iNqIiqFJtpqK3TOTZs2c/LnM7lq1lN0XrOcWbv14+9n/Ilzhp1CYffMXHdSZU7dGjhwoC0rK/P8vCLSuKKV+UyltKdXCopLo64ozMvNYVP1lrgV7/LzcqM+dAru+C89583impkT2WvFt3zcsTt3HvZHZnftV/e+2UWDPLuGeGVO1aMWEddS3QQ2XWLV6KiorIr7PgN1AX6r4ZBN33PvQ8P5zfef8k2bXbj0xGuYtufBWPNr/kUm91NUoBYR1/y6CWysGh3xGCByPKHTj9/S5uxb4fPZdG/VhuuPvoRn9z2a6uz6oTKT+ykqUIuIa7ECYuvcHAqKSxtt3DpWjY4WOVn8sqF+rzrbmK3GrDuuWcnw2c/w+0/eYENOc7jlFt494g9Mem0J1VGGTTK9n6LyqEXEtWhlPnOyDOs3V1NeUYnl1yGE8J1RvBa5CwvAHaf0IT8vF4MzfnzHKX24acg+UTetvecPfcnPy6V15VqK3hzPW48O5eTPSnl8wBBOv+ZpuP56hhT0rDsnOMGdsHNn8kGkHrWIuBataNGGzdX1eq3pHLeOleFxxyl9Yk7u1ctS6dWGHhPeoPO4+9lh43om9z6Cew8+m1U778Idp/TZ6nobO6MFlPUhIinqVjSt3lgvOGPA3xSf4PnnxcrwcJWFUV0Njz8Oo0bBsmX8dMhRjNjvdN5psUujpxoq60NE0iZRsX2vNWhC01qYPBmuuw4WLYKDDoJnn6XjIYfwZFpa6S2NUYtISqKNW6dzsi3WAyDmg+Gtt5zAfOqpkJ0NJSUwezYcckha2pcOCtQikpLC/vlRJ/LSNYTg+sHw0Udw3HFwxBFQXg7jx8PHH8NJJ0HtxGBQaOhDRFKWyUm3hLuwfPMN3HADPPMM5OU5BZSGDYPczOU9e81VoDbG5AGPAb1xcsT/ZK19L43tEhGJKeqDYflyp0jSww9Ds2YwcqTzk5fXKG30ktse9T+A16y1pxljtgO8L7gqIpJA1IJQ3XeEe++Fu++Gykq44AK46Sbo1Kmxm+uZhIHaGLMjcCjwRwBr7WZgc3qbJSKytcj86eX/W8On197KcR+8QPNf/udMFt52G/TK3IrBTHHTo94dWAE8bozpC8wFLrfWrg8/yBgzFBgK0KVLF6/bKSKNrLHLm4YKQhm7hSEL3+aqWU+xW8VPzN29HwNemw4HHJCxtmSam6yPZsB+wEPW2v7AeqAo8iBr7Thr7UBr7cB27dp53EwRaUyh3mwml4mHf3ZBcSnlv2zgsCVzeWXCcO57+W7Wb5fLub8fzWmn3dKkgzS461H/APxgrX2/9t8vEiVQi0jTFau86aipn8XdVSXVHnjoAdFz6eeMmTmR3373Md+17sBlQ67m5b0OxZqsulocTVnCQG2t/ckY870xppe1dhFwJPB5+psmIn4Rr95zqOZz5K4qDdn6KtKzT73B3dMe5YRFs1m5fWtuOuoinul3LFXZOUDmq9g1FrdZH38Fnq7N+FgCnJ++JomI37it9xwqxhT6PdprrgL1smUwejRPPfoYG3OaM7bgLB7bv5D1zX9NOMv3yTZgmeAqUFtrFwBRi4WISNMXrd5zLPFqbiTcYKCiAu66C/7+d6iuZvKBJ1E84FT+1zJvq8O83gbL77QyUUQSclveFH6tuZGoUFP4GHbXltncv2o2vSc+6ATrs86Cm28mZ3VzNrz0CURsCLAtDHeEU6AWEVciVwPG2ug2FETjvRa+w/dpn5ZyxTtP02ntSn7+7eF0eHAs9OtXF8grq2rqdmTZloY7wilQi2zDUsnMSFhzI85rY177goM/n82ImU/Q83/fsWCXnlw5+Eq+3/c3zK4N0uGBvsbaukC/rQVp0MYBItusWD3itG8zNWsWZWdexMDyhSzeqTN3HXouM3oeVFfRLj/OxGW0senGXojjFW0cICL1xMqNTtcWWnzyiVO4/5VX2G3HthQdcykv7Ps7arJ+LVlqiD62HRI5GRlrWy5ILg3Q71SPWmQb1aCdUhpi6VI47zzo2xdmzYLiYua8Oocp+59QL0gn+n4fuTlAvIdNU6JALdLERe7YHVr2HWtHFAtbHddgK1fClVdCz57w3HNw9dWwZAmMHMmQ33bfarOBvNychEE6WrZHxh42jUyBWqQJi1ejI9pOKSEp1fJYv96pC73HHvCPf8DZZzNj8iwKdjqWbne9V/cQKOyfz+yiQYw9vR+bqrfEPWWsXWOS3pYroDRGLdIEhSbYoo33hoYGQpNyiY5zPdZbVQWPPQY33ww//QSFhXDbbZRsah13HDna8EVIosnNaAtxcnOyOWLPdhQUlwZ+gjFEPWoRD8QaXmistoR60bGEhgZCvdpYOwi6GkLYssUZ2th7b7jkEujRA95919n1e++9E44jx/uMRBko0fZrPHVAPpPmljdKpb90UY9aJEV+yzyI10MNiRwaiFXLI+EQwhtvQFERzJ0LffrAK69QsktfxvznS5ZNmRa3RkgoQMc6Jj8v19V/v8iFOAXFpZnNZskA9ahFUtQYmQfxevCJesHRJuVc7+wdMncu/O53zs/KlfDEEzB/PiWd+nHt5E+36s3G6q2HHgJJf3YCbiYY/fQNyA31qEVSlOnMg0Q9+Hi92GxjtnqIhHqYblYZAvD113D99c5QR9u2MHYsXHwxNG9e9/7Ih5Yleurdhs3VdZOKrj7bpUTfDvz2DcgNBWqRFDV42KCBEi1UiTbBlpNlwEBVjRMuowWnqDt7h/z0kzNJ+OijsN12TrC++mpo3Xqrw2I9nCxOCl6odjXALxuqtmqDV0Ey1gRjqIee8YU+HtDQh0iKvP7qnkiiHny0CbZWLZrVBemQWMMz4cMCvxv1MosuHO6k2j36KAwdCosXwy231AvSEPvhlJ+XS8vm9fuF6Rgiinb94ZOSQcy9Vo9aJEVef3VPxE0PPrKH2q1oWtRzxVqSXVO5kfPnT+fS955jp8o1/HD0iXR+8B7o3j1u2+L1Zq94boGrNnghXg8909+AvKBALeIBL7+6J5Loq300boPTPa9+znHz/8OVs56m85rlvN21P3cddh6/7NmH2QmCNMR/aMXK1850gGzIf7/GpkAtEjAN6cEnDE7WwvTpPDp2GHuuXMrHHbsz8rjLmN21HwAmiV5vrIeWXwJkpr8BeUGBWiSAku3Bxw1O770HI0fCrFm0bJvPsBNHMn3PAqz5dQrLi16vnwJkJr8BeUGBWsSnvK6zXC84ff45FA6DKVOgY0d46CHm7XcspS9/gU1TrzdoAdIvFKhFfCitub7ffw+jRsGECdCqlVNAafhwaNmSkwCbk+OLXq/8ylWgNsZ8C6wFaoDqWLsQiIg30pLru2oV3HEH3H+/MyY9fDhcey3svPNWh6nX6z/J9KiPsNauTFtLRKSOp7m+GzbAffdBcTGsWQPnngujR8Nuu6XYSskUDX2I+EDkeHTe9jn8sqGq3nFJTepVV8P48U5QXrYMBg+G2293iidJoLhdmWiB/xhj5hpjhkY7wBgz1BhTZowpW7FihXctFGniohX3X7exmpzsrcsZuZ7UsxYmTYLeveGii6BrV2cLrJdfVpAOKLc96gJr7TJjTHvgdWPMF9bat8MPsNaOA8aBswu5x+0UaTIie88bNlfXG4+u2mLJy82hZfNmyU3qvfmmU3b0gw+c+tBTpsCQIXU7fEswuQrU1tpltf+73BgzGTgAeDv+u0QkUrRsjlhWV1ax4Kaj3Z14wQJnYvC112DXXZ0hj3PPhezoW21JsCQc+jDGtDTG7BD6HTga+DTdDRNpitwU9Q9xNR69ZAn83/9B//7w/vtw993w5Zdw/vkK0k2Imx51B2Cycb46NQOesda+ltZWiTRRbrM2Eo5HL1/u5D8//DA0a+b0pq+5BvLyvGmo+ErCQG2tXQL0zUBbRJq8WMWRXI9Hr10L99zj/FRWwgUXwE03QadOGWi9NBal50kgeb28OlNiFSYadeI+MdtfMr+csdM+5YiZk7ns3WfZacNqpvcq4MkTLuT0s4+iUEG6yVOglsDJ5FZKiR4IyT4wki1MVDL3e9659QGefHMiXVb/zLtd9uXOw87jo07OsMiCiOsO6gNM4jPWep9JN3DgQFtWVub5eUXA2WU61q7Vs4sGefY5kQ8EcHq/od1CEr2eEmthxgy+/NNf6fnj13zWfnfuPOw83u62X71Uu9B1p7U9knbGmLmxynNoKy4JnExtpZRod/G07T7+wQcwaBAcdxzNK9dx2ZARDP7j33l79wFR86FD190Yu6FLZmjoQwInU1spJXogeP7AWLQI/vY3Z1Vh+/Zw//2cW9GDpeuq474tdN1B3AtQ3FGPWgInU5vJxgr8ob8net218nJn09h99oEZM5zaHF9/DZdeyhUn9K53reHCr9uz9ojvKFBL4CTaZdoriR4IKT8wKiqc/OcePZza0MOGOTt833gj7LADUP9a83JzaLN9TtTrTscDLHxH8oLiUkrmlzf4XNJwmkwUicPrrA/AyX9+4AGnNnRFhbOy8OaboVu3tLc32XNpcjJz4k0mKlCLZEp1NTzxhLNA5Ycf4LjjnGDdN7X1ZOlKyctUdo044gVqTSaKpJu1ThW7666DhQvhgAPgySfh8MPrHZps0E1nTrkmJ/1DY9QiETwdl501CwoK4OSTYcsWJ6NjzpyYQTqyLvW1L30S9/PTmZKnyUn/UKCWQEn35FZDgmVUn3zi7Khy6KGwdCnzb7iLQ8+5n24fNKfgzjejnq8hQTedvd5MZddIYgrUEhieBdE4Uu6hLl0K553njDvPng3Fxbz8wkzOsn34bu3muO1uSNBNZ683U9k1kpjGqCUw0rIzd4QG91BXroTbboN//hOysmDECGenlTZtKC4uddXuhizkiVXkyater3Yk9wcFagmMTExuJR0s16+HsWPhrruc388/H0aNgs6dE7avvKKSguLSuonDI/Zsx6S55UkF3WSLPEkwKVBLYGRi6bjrHmpVFTz6qJP//PPPUFjo7PC9116u2234dSuu8opKJs0t59QB+bz5xYqkgq56vU2fArUERrq/5kP8HmrJ/HLufnUh/d5/naJ3nqLzqmXOZOHkyXDQQUm12wCRKxgqq2p484sVGclRVjnUYFGglsDI1Nf8aD3UkvnlvHz3RB7673j6/LyYhe268sfTbuKj3gdxU4suFEY5T3gwbJ2bQ4ucLCo2VMXsYUNmcpQzWc9bvKFALYGS6Gt+WnqKZWXkn3ER/1o8jx92bM8VJ1zJlL0PY0tWNlRWRw1ykcGworKK3Jxsxp7ej8L++TFX/WUiRzkTk7LiLaXniSf8ULzH8/S9r76C00+H/fdn92VfM/rICxl04SNM7j3ICdK1oqXvJUrza8wcZa04DB7XPWpjTDZQBpRbawenr0kSNH75Kh0rOF71/EfJteWnn5xJwkcfhebN4YYbOCNrf77aGLtfExnkEgXDxszWyFQ9b/FOMkMflwMLgR3T1BYJKL98lY4VHGusdffgWL0axoxx0u02b4aLLoIbboAOHRgWpZJcuPAgVzK/nCxjqIlS8Cz8uMbK1sjEpKx4y9XQhzGmM3AC8Fh6myNB5Jev0vF6hHFXF27c6ATnPfZwFq2ceKJTPOmBB6BDB+DXVXp5uTn13h4e5ELfLqIFab8EQ604DB63Peq/A9cAO8Q6wBgzFBgK0KVLl5QbJsHhl6/S0XqK4eo9OGpq4KmnnEL9330HRx/tlB3db7+o7w/1gONNWEb7dgGQbYyvgqFyr4MlYaA2xgwGlltr5xpjDo91nLV2HDAOnHrUXjVQ/M8vX6VDgeeq5z+KP+xgLUyb5uyu8umnMHAgjB8PRx7p+nNiBblY3yK2WKvAKA3mZuijADjRGPMt8CwwyBjzVFpbJYHip6/Shf3zuecPfWNnVLz7rrNIZcgQZ8jj+eedXb9dBulEVBpU0iGpHV5qe9RXJ8r60A4v0tgihydu7g5HPvkPmDoVOnZ0dlm54ALIqT/mnOrnavsqaQjt8CLbnLrhie+/d4Ly3yZCq1bOZOHll0PLlmn7XFCRJPGW9kyURpPWehOrVjkTg/ff74xJX3qpsxVW27bp/2yRBlCPWnzHy0Uy4UG32/aG+1fMYp8nH4I1a5wi/qNHQ1gmUqzPLlu6KunKdSKZoB61NIpYtS7AmYx0GyRDQXfzps384ePXGT77GTqsW8WPh/6OXR68F3r33urYMTMWxfzcyIp2GluWTFKPWnwn3mKYZHrXY177gsM/mcnVs55kj1XllOXvxbCTRvJj74HMrg3SJfPLGTX1Myoqq+KeK1rZURUqEj9QoJZGEa/UJ7gMkm++yT/vv5i+P37Fl2278OdTbuCN7geAMZjac0fLwkiGChWJHyhQi2teTsAlWkUIcYLk/PnOYpUZM+jQuj1XHz+cl/Y5YquKdqG85VgrBSNFK+Qffh6RxqQyp+KK1yVEwxfJxFIvSC5ZAmed5Szx/vBDuPtuPnjtXabtd8xWQTp8VaSbHnF+Xi7/d2CXRis7KpKIetTiSjoq5IXXzoi7BP3nn+HWW+GRR6BZMyfNbsQIyMvjRGBL8xYxe/rxhlgiJwsH7raTUvbElxSoxZV0VsiLuUik+47OYpV77nGWe//5z04BpU6d6r0/VkCNNcTSZvscbhqyz1bvU6Ei8SsF6iYgE4s30l0hb6sguWmT03s+5lZYsQJ+/3unR92zZ4POC1opKMGmQB1wmdpdJSMV8rZsgX//G66/Hr79FgYNguJi2H//lE6rnrIEnSYTAy7R3nxeSWuFPGvh1VedScKzz4a8PJgxA954I+UgLdIUqEcdcJncXSUtPdP334eRI2HmTNh9dz68/QGusL0oL91E6/dexxj4ZUMV2bVbWyWzalGkqVCgDji/7K6SSOQ4+uie2Rz19H3w0kvQvj088ABT9j+eopcXUVm1CWCrlYShjQAaa+NckcakoY+AG3FML9/n/4bnYLdfu5JL/30nh582iKrXZjgFkxYvhmHDuKv0G1eLU9IxtCPiZ+pRB1wQshrGzFhEztrVXDbnRc6fO5WsLVt4Yr/BPPDb08ndriMjvlpNYf9WSQ3XaGm3bEsUqJsAX2c1VFYyZMaT/GXOi+y4cT0l+xzOvQf/Hz/kdXReDxvKSFT/I5zfhnZE0kmBWjxXMr+ce6d/zkHvvMJV7z5D0ZqVlO4+kLsOO48v2nerd3xoKMNN/Q/w39COSLopUIunSub9wBvF4/hX6QR6/O975u/SiyuGXM0Hu/WhqiZ27fNlFZX1hnFa5+Yo60MEBWrx0ttvs8c5F1P43ed8vVNnLjr5Omb0OAiMIW+7ZrRs3izm0EZoKCPTwzjakkuCQIFaUvfxx07Z0enT2blVW0Ye+1de7HMUNWEV7VZXVrHgpqMTF2DKoEyt6hRJVcJAbYxpAbwNNK89/kVr7U3pbpj8yre9vm+/dYokPfUUtG4Nd97JWZv68M36LfUODe8xgz+yVNJREVAkHdz0qDcBg6y164wxOcA7xphXrbVz0tw2wae9vhUr4Lbb4KGHICvLKTlaVARt2nC5ix6zX7JUMrmqUyQVCQO1dXa/XVf7z5zaH+93xJWovOz1pdwzX7cOxo6FMWNg/Xr405+cMqSdO9cd4qcecyJBWdUp4moXcmNMNjAX6A48aK0dGeWYocBQgC5dugxYunSpx03dNnUrmhb1qWiAb4pPcH2eaGPDoe2nomVShAf1Lq2acd+6MvpOuN8p4n/yyU6Peq+9GnxdfhBrvFw7j0tjSHkXcmttDdDPGJMHTDbG9LbWfhpxzDhgHMDAgQPV4/aIV72+aD3z0E2KHE4JBbCNm6sYvHAWV816iq4VP7JywIHsXFJCSfNdGTNlEcsmLqlLoavYUOXr3nM0Qer9y7YtqawPa22FMeYt4Fjg0wSHN1mZnNzzqg50onHX8OGUMTMWMeDLMopmTqD3z4tZ2K4rfzxtFF/tdzAjmu+6VXvCCyf5Yvw8SX4ZLxeJx03WRzugqjZI5wJHAXemvWU+lenJPa96fW6WZy+rqISyMu58+EoOXvoRP+zYnuGDr2LK3odhTRZm9caEu3ora0LEe2561LsAE2vHqbOA5621r6S3Wf7VGCldXvT6Ei3P7rqqnBvmPAN3zmSflq0ZfeSFPN3veDY3y6k7JssYV7U4lDUh4i03WR8fA/0z0JZACGJKV2ioprKqpm4pdmgisd26VVw++9+c8dEMaNECbryR2UedybP/+ZbNEUE9/H3xhMbPfZv/LRIwWpmYpKCldEUO1dRYS25ONmftuSNdHnuQ38+exHY11Xz3+3PY/b47oUMHBgPVrXbgquc/qivYH2IhbrAOjZ/7Mv9bJKC0cUCS/FSov2R+OQXFpXQrmkZBcSkl88vrHRM5VNO8ejNnzX6Ryy48lvPeeobtTzuFZl8uYvfnJkCHDnXHFfbPZ0uM1M1QSp8B8nJzaLN9Tr19FDO1l6PItkA96iT5JaXLbY81NCSTtaWGUz57k+HvPE3nNSt4u2t/Dp30mLOhbAyxvj3k5+Uyu2hQ3PYFcYhIxK8UqBvADyldbic1O7VuwZ5zZ3LNzIn0WvkdH3XswYjjh/Nd3wOZHSdIQ2qpgUEbIhLxMwXqNEvXhJqrHuvs2Ux9/lraLviQJW06cclJRUzvVUDuds24w0WwTeXbg1f53yKiQJ1W6ZxQi9tj/ewzuO46mDqVtrvswoLrirls+/58v7Yq6cL7Df324JchIpGmwFWtj2QNHDjQlpWVeX7eoCkoLo0aTLON4Z4/9E0paEWrU7H7hv/x+LfT2G3ai9CqFYwcCZdfDi1bNvhzRCQzUq71IQ0Ta3iixtqUe9bhPdYNP/7MiPmTOf39qWQb4IornEL+bds26Nwi4i8K1GkUb9m2F6sZC3vmUfjqHJhwp1OC9NxzYfRo6NKlQefTAhURf1IedRpFy7kO1+BUtaoqeOQR6NED/vY3OPxwZzusxx9PKUhf+9InlFdUYvl1PD1abraIZJYCdRoV9s/njlP6kG1M1NeTTlWzFl54AfbZB/7yF9h9d3jnHZgyxflbCrRARcS/NPSRZqGhg5RT1UpLne2uPvzQCcpTp8LgwRDjIZDsMIYWqIj4lwJ1BrhJVYsZWOfPdwL0f/4Du+4KEybA2WdDduwhlYakBWqBioh/KT3PB6Kl2vVc+zP/WjKVXV+bAjvt5IxFX3KJU+EugVhpgfGWfmtbKpHGpfQ8nwsfH955/S/89d1nOWvBa9RkN3MWrlxzDbRu7epcJfPLY2aaxBvG0AIVEf9SoPaBZRWVtNq0gQs/mMyfP5xM8+rNPNv3GO4rOJMPbjvH9XlCveJYEg1j+KGGiYjUp0Dd2DZt4vLPpnPOf5+ibeUaXul1MPcceg7f7JRPvgcb2IaozoZIcClQp6jBi0S2bIFnnoEbbmD4t9/yXte+3H7oH/lklx6AE1iP2LMdBcWlKWduABprFgkw5VGnoEGLRKyF6dOhf3845xxo0wZmzODnSa+waq996wrwnzogn0lzy5M6d6yhjfy8XAVpkQBrsj3qVJdDu3l/0hvdzpnjpNrNnAl77MGHdzzIFVt6Ul66iU55X271GQXFpUlvoqvSoiJNU8JAbYzZFXgC6AhsAcZZa/+R7oalItXyosnunhKp3t+/+MLJ3pg8Gdq3hwceYMr+x1P08iIqqzZF/YyGLEBpSOaG6nuI+J+bHnU1cJW1dp4xZgdgrjHmdWvt52luW4Ml3dNt4PsTLhIpL4dRo2D8eKfU6M03O5XtWrXirgQ95oYuQEkmc0Mb0IoEQ8Ixamvtj9baebW/rwUWAr7+f3Gqy6Hdvj/WRrfXHdTBqQXdvTtMnAh//SssXgw33ODUiXbxGZnYRFf1PUSCIakxamNMV6A/8H6U14YCQwG6NLCCm1dSXQ7t9v2RQw1dW2Zx/8pZ9C78J6xe7Sz1vvlm6No16c/IxAIU1fcQCQbXgdoY0wqYBAy31q6JfN1aOw4YB84Scs9a6ELkOOsRe7Zj0tzyBk+qJTMpV9g/n8I+HZwaHKNGOcMdxx8Pd9wB++6b0mekewGK6nuIBIOr9DxjTA5OkH7aWvtSepuUnGgpcpPmlnPqAGfBSCjdLZk84lB50oTvt9aZIOzTBy68kE+zduT0s4opOOQqSmri767i+jPSKBPDKyKSuoRFmYwxBpgIrLLWDndz0kwWZWpIAaJkxMyKmDnTSbWbM4e1Xbtz7f5n8kq3A+rKjgaloJGyPkT8IV5RJjeB+mBgFvAJTnoewHXW2umx3pPOQB0ZWGIVIDLAN8UnJH2+8EAVraLcXsu/YcTMiQxaUkZl+47k3n4rh/7Uhe/Wbq53bq8eFiLS9KVUPc9a+w5O3Gt00dLJDBDtUeNmnDVRelp4VkTn1T9z5aynKPzsLdY2357bDz+f539zEqP2G8j3zy2Ien5NyomIFwK1MjFaOpmFesHa7ThronzpZRWV7LRhNZe++xxnz5/OlqwsHvnNqTx04GmsadGq7hyalBORdApUrY9YPVQLdZNyebk5tMjJ4ornFlBQXBq3Nkbc9LR16/jb3BeY+cifOW/eK0zqPYjDLxzHnYf/sS5Ih47VpJyIpFOgetSxeq6hseBkV9pFO19OTRUXLyqFPf7En5cv5z97FnDnwWezuO2uMdukovsikk6BCtSJco+TXToefj5jtzBk4SyunvUkXSp+gsMOgylT2NB8VzbOWARRxsPDP1tF90UkXQIVqBP1XJNdaVfYPx+sZeYDz3DB9HH0/nkxq3vsBc+Mh2OPBWMoDPtcP6Sy+aENIpJZgQrUEL/nmvSk3ocfUlhURGFpqbPM+8knaX3WWZAVfei+sXvNKqIksm0K1GRiIq4n9b78Ev7wBzjgAPj4Y/jHP5xSpGefHTNIe6lkfjkFxaV0K5qWcMIznIooiWybAtejjifhpN6PP8Lo0fDYY9CiBdx4I1x1Fey4Y8bamEqvWEWURLZNgQ7UscZr6wW81avhrrtg7FioroaLL4brr4cOHVydz6t2QWq1spWvLbJtCmygdtUz3bgRHnwQbr8dVq2CM8+EW26BPfZo2Pk8aFeiXnG8IK+ttkS2TYEdo447XltT45Qd7dkTrr4a9t8f5s1zdv2OEqQTns+rdhG799spLzfhZrl+qLgnIpnnux612+GHqD1Ta9n7w7eg72Xw2WdOgJ4wAQYlLozk1fivm51bYvWK3QyLNHbmiYhknq8Cdaxhg7Klq3jzixVbBe/I8dqBP3zGyLcmsn/5505P+oUX4NRT68qOJuLV+G8qO7dcoeJOIhKFrwJ1rB7l03O+q1sRGArepw7IZ9LccnZdtpgRbz/B777+gOWtdmL+34rpf9OVkJOT1Gd7Nf6bys4tmiwUkWh8FajjFV0KV1lVw+dzPuW1z0vY9ZUXWLfd9jx8zAXk31jEkN92b9Bne1WvI5XzaLJQRKJJuHFAQzR044BYu7WEy6tcw7D3nufcedNo3izL2eG7qAjaxt/6Kii0RFxk25TSxgGZFK1HGSqElLt5I38qm8JF70+iZdVGXt3vaAa/9Ag08o7nXtNkoYhE8lWgjjZscGT3PLLGP84lbz9N+/W/8Hr333DfkedzwUWDoYsCmog0fb4K1BDWo7TWydy47i/w1Vd81LU3lxRey4+9B2g4QES2Kb4L1AD897/OuHNZGeyzD0ydSt/Bg3nRZaqdiEhTkjBQG2PGA4OB5dba3mltzbx5ToB+/XVn7HnCBKeiXXZ2wre6oYk6EQkiN0vIJwDHprkdUFEBhxwCc+fCvffCokWU7HsUBWNmJl0ONJpEy7NFRPwqYY/aWvu2MaZr2luSlweTJ8NvfgOtW3teJD+VqnUiIo3JX0WZjj4aWrcGvC+Sr1rOIhJUngVqY8xQY0yZMaZsxYoVKZ/P68Aar2qdiIifeRaorbXjrLUDrbUD27Vrl/L5vA6srrfpEhHxGX8NfYTxMrCGsj0qq2rIrk3xy8vNoUVOFlc8tyDliUoRkXRKGKiNMf8G3gN6GWN+MMZckP5meVckPzzbA6DGWnKyDOs3V/PLhiplgIiI7/mqKFM6uCn0FJKfl8vsosSbDIiIeC1eUSbfDn14JZnJR2WAiIgfNflAnczkozJARMSPmnygjjYpmZNlyMneum6IMkBExK/8WZTJQ7F2XIn2N61QFBE/avKTiSIiQRCIHV5U2U5EJDpfBGqvCzCJiDQlvphM9LoAk4hIU+KLQK3KdiIisfkiUKuynYhIbL4I1KpsJyISmy8mE2PlOmsiUUTEJ4EanGCtwCwiUp8vhj5ERCQ2BWoREZ9ToBYR8TkFahERn1OgFhHxubRUzzPGrACWNvDtOwMrPWxOY2oq19JUrgN0LX7UVK4DUruW3ay17aK9kJZAnQpjTFmsUn9B01SupalcB+ha/KipXAek71o09CEi4nMK1CIiPufHQD2usRvgoaZyLU3lOkDX4kdN5TogTdfiuzFqERHZmh971CIiEkaBWkTE5xolUBtjjjXGLDLGfG2MKYryujHG3Ff7+sfGmP0ao51uuLiWw40xq40xC2p/bmyMdiZijBlvjFlujPk0xutBuieJriUo92RXY8ybxpiFxpjPjDGXRzkmEPfF5bUE5b60MMZ8YIz5qPZaRkc5xtv7Yq3N6A+QDSwGdge2Az4C9o445njgVcAABwLvZ7qdHl7L4cArjd1WF9dyKLAf8GmM1wNxT1xeS1DuyS7AfrW/7wB8GeD/r7i5lqDcFwO0qv09B3gfODCd96UxetQHAF9ba5dYazcDzwInRRxzEvCEdcwB8owxu2S6oS64uZZAsNa+DayKc0hQ7ombawkEa+2P1tp5tb+vBRYCkUXbA3FfXF5LINT+t15X+8+c2p/IrAxP70tjBOp84Puwf/9A/Rvm5hg/cNvOg2q/Jr1qjNknM03zXFDuiVuBuifGmK5Af5zeW7jA3Zc41wIBuS/GmGxjzAJgOfC6tTat96UxdngxUf4W+TRyc4wfuGnnPJw1/OuMMccDJUCPdDcsDYJyT9wI1D0xxrQCJgHDrbVrIl+O8hbf3pcE1xKY+2KtrQH6GWPygMnGmN7W2vA5EU/vS2P0qH8Adg37d2dgWQOO8YOE7bTWrgl9TbLWTgdyjDE7Z66JngnKPUkoSPfEGJODE9ietta+FOWQwNyXRNcSpPsSYq2tAN4Cjo14ydP70hiB+kOghzGmmzFmO+AMYGrEMVOBc2tnTg8EVltrf8x0Q11IeC3GmI7GGFP7+wE4/83/l/GWpi4o9yShoNyT2jb+C1horb03xmGBuC9uriVA96VdbU8aY0wucBTwRcRhnt6XjA99WGurjTGXAjNwsibGW2s/M8b8pfb1h4HpOLOmXwMbgPMz3U43XF7LacDFxphqoBI4w9ZOC/uJMebfOLPuOxtjfgBuwpkkCdQ9AVfXEoh7AhQA5wCf1I6HAlwHdIHA3Rc31xKU+7ILMNEYk43zMHneWvtKOmOYlpCLiPicViaKiPicArWIiM8pUIuI+JwCtYiIzylQi4j4nAK1iIjPKVCLiPjc/wPCCvjKMZGi9wAAAABJRU5ErkJggg==",
831 "text/plain": [
832 "<Figure size 432x288 with 1 Axes>"
833 ]
834 },
835 "metadata": {
836 "needs_background": "light"
837 },
838 "output_type": "display_data"
839 }
840 ],
841 "source": [
842 "plt.scatter(train_x,train_labels)\n",
843 "x = np.array([min(train_x),max(train_x)])\n",
844 "with torch.no_grad():\n",
845 " y = w.numpy()*x+b.numpy()\n",
846 "plt.plot(x,y,color='red')"
847 ]
848 },
849 {
850 "cell_type": "markdown",
851 "metadata": {
852 "id": "0giuwC9GHzi8"
853 },
854 "source": [
855 "## Computations on GPU\n",
856 "\n",
857 "To use GPU for computations, PyTorch supports moving tensors to GPU and building computational graph for GPU. Traditionally, in the beginning of our code we define available computation device `device` (which is either `cpu` or `cuda`), and then move all tensors to this device using a call `.to(device)`. We can also create tensors on the specified device upfront, by passing the parameter `device=...` to tensor creation code. Such code works without changes both on CPU and GPU: "
858 ]
859 },
860 {
861 "cell_type": "code",
862 "execution_count": null,
863 "metadata": {
864 "colab": {
865 "base_uri": "https://localhost:8080/"
866 },
867 "id": "HK7HPLz3Hyrl",
868 "outputId": "7e14cccb-d376-4e59-be66-4ab3f5c3f6f4"
869 },
870 "outputs": [
871 {
872 "name": "stdout",
873 "output_type": "stream",
874 "text": [
875 "Doing computations on cpu\n",
876 "Epoch 0: last batch loss = 94.5247\n",
877 "Epoch 1: last batch loss = 9.3428\n",
878 "Epoch 2: last batch loss = 1.4166\n",
879 "Epoch 3: last batch loss = 0.5224\n",
880 "Epoch 4: last batch loss = 0.3807\n",
881 "Epoch 5: last batch loss = 0.3495\n",
882 "Epoch 6: last batch loss = 0.3413\n",
883 "Epoch 7: last batch loss = 0.3390\n",
884 "Epoch 8: last batch loss = 0.3384\n",
885 "Epoch 9: last batch loss = 0.3382\n"
886 ]
887 }
888 ],
889 "source": [
890 "device = 'cuda' if torch.cuda.is_available() else 'cpu'\n",
891 "\n",
892 "print('Doing computations on '+device)\n",
893 "\n",
894 "### Changes here: indicate device\n",
895 "w = torch.tensor([100.0],requires_grad=True,dtype=torch.float32,device=device)\n",
896 "b = torch.zeros(size=(output_dim,),requires_grad=True,device=device)\n",
897 "\n",
898 "def f(x):\n",
899 " return torch.matmul(x,w) + b\n",
900 "\n",
901 "def compute_loss(labels, predictions):\n",
902 " return torch.mean(torch.square(labels - predictions))\n",
903 "\n",
904 "def train_on_batch(x, y):\n",
905 " predictions = f(x)\n",
906 " loss = compute_loss(y, predictions)\n",
907 " loss.backward()\n",
908 " w.data.sub_(learning_rate * w.grad)\n",
909 " b.data.sub_(learning_rate * b.grad)\n",
910 " w.grad.zero_()\n",
911 " b.grad.zero_()\n",
912 " return loss\n",
913 "\n",
914 "batch_size = 4\n",
915 "for epoch in range(10):\n",
916 " for i in range(0,len(features),batch_size):\n",
917 " ### Changes here: move data to required device\n",
918 " loss = train_on_batch(features[i:i+batch_size].view(-1,1).to(device),labels[i:i+batch_size].to(device))\n",
919 " print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
920 ]
921 },
922 {
923 "cell_type": "markdown",
924 "metadata": {
925 "id": "A10prCPowHl7"
926 },
927 "source": [
928 "## Example 2: Classification\n",
929 "\n",
930 "Now we will consider binary classification problem. A good example of such a problem would be a tumour classification between malignant and benign based on it's size and age.\n",
931 "\n",
932 "The core model is similar to regression, but we need to use different loss function. Let's start by generating sample data:\n"
933 ]
934 },
935 {
936 "cell_type": "code",
937 "execution_count": null,
938 "metadata": {
939 "id": "j0OTPkGpwHl7",
940 "scrolled": false,
941 "trusted": true
942 },
943 "outputs": [],
944 "source": [
945 "np.random.seed(0) # pick the seed for reproducibility - change it to explore the effects of random variations\n",
946 "\n",
947 "n = 100\n",
948 "X, Y = make_classification(n_samples = n, n_features=2,\n",
949 " n_redundant=0, n_informative=2, flip_y=0.1,class_sep=1.5)\n",
950 "X = X.astype(np.float32)\n",
951 "Y = Y.astype(np.int32)\n",
952 "\n",
953 "split = [ 70*n//100, (15+70)*n//100 ]\n",
954 "train_x, valid_x, test_x = np.split(X, split)\n",
955 "train_labels, valid_labels, test_labels = np.split(Y, split)"
956 ]
957 },
958 {
959 "cell_type": "code",
960 "execution_count": null,
961 "metadata": {
962 "id": "c-_BjSHPwHl8",
963 "scrolled": false,
964 "trusted": true
965 },
966 "outputs": [],
967 "source": [
968 "def plot_dataset(features, labels, W=None, b=None):\n",
969 " # prepare the plot\n",
970 " fig, ax = plt.subplots(1, 1)\n",
971 " ax.set_xlabel('$x_i[0]$ -- (feature 1)')\n",
972 " ax.set_ylabel('$x_i[1]$ -- (feature 2)')\n",
973 " colors = ['r' if l else 'b' for l in labels]\n",
974 " ax.scatter(features[:, 0], features[:, 1], marker='o', c=colors, s=100, alpha = 0.5)\n",
975 " if W is not None:\n",
976 " min_x = min(features[:,0])\n",
977 " max_x = max(features[:,1])\n",
978 " min_y = min(features[:,1])*(1-.1)\n",
979 " max_y = max(features[:,1])*(1+.1)\n",
980 " cx = np.array([min_x,max_x],dtype=np.float32)\n",
981 " cy = (0.5-W[0]*cx-b)/W[1]\n",
982 " ax.plot(cx,cy,'g')\n",
983 " ax.set_ylim(min_y,max_y)\n",
984 " fig.show()"
985 ]
986 },
987 {
988 "cell_type": "code",
989 "execution_count": null,
990 "metadata": {
991 "colab": {
992 "base_uri": "https://localhost:8080/",
993 "height": 283
994 },
995 "id": "tq0vFchQwHl8",
996 "outputId": "919f1922-f789-4779-cbdc-4f9e742c358b",
997 "scrolled": false,
998 "trusted": true
999 },
1000 "outputs": [
1001 {
1002 "name": "stderr",
1003 "output_type": "stream",
1004 "text": [
1005 "C:\\Users\\dmitryso\\AppData\\Local\\Temp/ipykernel_89704/2721537645.py:17: UserWarning: Matplotlib is currently using module://matplotlib_inline.backend_inline, which is a non-GUI backend, so cannot show the figure.\n",
1006 " fig.show()\n"
1007 ]
1008 },
1009 {
1010 "data": {
1011 "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYQAAAEKCAYAAAASByJ7AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAABPHElEQVR4nO2dd3zcdf3HX+9cdtI0bVZX0rSllFE6IGUIlD1lCKKADAeKA1DABeJGFMWJCtIfAqKIioJI2UihjIIU6KSFriTdTbN3crn374/XfXuX5HKjuZm8n4/HPZL73vfu3rc+7897i6rCMAzDMNISLYBhGIaRHJhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAAOmJFmA4FBcXa2VlZaLFMAzDSCnefvvtvapaMvB4SiuEyspKLF++PNFiGIZhpBQiUhPouLmMDMMwDACmEAzDMFKLvj6guxuIQZeJlHYZGYZhjBo2bwZeeAF4803A4wHy8oDTTweOPx4YNy4qT2EKwTAMI9lZsgT405+AzExg0iTA5QK6uoDHHgOefx74xjeA8vJhP425jAzDMJKZDz4A7r+fisBRBgCQnQ1Mncr/f/UrKohhYgrBMAwjmXnqKSA/n9ZBIIqKgIYGYMWKYT+VKQTDMIxkpb0dWLUKKC4Ofl5BAfDKK8N+OlMIhmEYyYrjBkoLsVRnZgItLcN+uqRRCCKSLSL/E5GVIrJWRH6QaJkMwzASSl4eIMJU02B0ddF1NEySRiEA6AZwsqrOBTAPwJkicnRiRTIMw0gg2dnA0UcDe/YEP6+tDTjxxGE/XdIoBCVt3qsZ3ovN9zQMY3Rz5pmA2814QiB27QKmTAEOPXTYT5U0CgEARMQlIisA7AHwvKq+GeCcq0VkuYgsr6uri7uMhmEYcaW8HPjKV4DmZqC2loqhpwdobAS2bAHGjwduuAHIyBj2U4nGoPx5uIhIIYDHAFynqmuGOq+qqkqtuZ1hGKOC+npg2TJmE3V2AqWlwGmnAfPmAVlZET2UiLytqlUDjydlpbKqNonISwDOBDCkQjAMwxg1FBUB55zDS4xIGpeRiJR4LQOISA6AUwGsT6hQhmEYo4hkshAmAviTiLhARfUPVV2cYJkMwzBGDUmjEFR1FYD5iZbDMAxjtJI0LiPDMAwjsSSNhWAYRoLo62NHzZ072UmzogKorGSFbLLR1wesWwds2MCZAFOnAocdFnGWjREYUwjGkHg8rIgXYcFkMq4PxjBZuxa47z52y/RPQa+oAD73uaj02I8aGzYAd9/N/Pu0NF56e4HcXOBTnwKOPDLREqY8SVmHEC5WhxAbOjuB119n192GBh6bOhU4+2zgiCN87diNFGfNGuDnP2dhU0GB77gqc97dbuDb32YVbKLZvBm47TbKOXZs/9s6Olite+21phTCZKg6BIshGP1oaQF+8hPgwQdpEUydys1iYyPw298CixZxnTBSHLcbuPde5rb7KwOAH3xxMf8+9FBi5PNHFfjLX4CcnMHKAKCFMGECJ4r19MRfvhGEKQSjH/feC+zYAUybxpkcANeFceOA6dOBN96g5WCkOOvWAU1NwJgxQ59TWsrzdu6M/vN3dACrVwPvvMPdv8cz9LnbtvGcYN08c3PZ0mHt2ujLOoqwGIKxj+3bOYvDmco3EBFO8HvmGeCMMyyOl9LU1obusS/Cc3buBCZOjM7zdnUB//438OKLtFJEqAzKyoCLLwbmB8g837OHcoQKYrlc/BIHegwjLMxCMPaxejV/c8F+d1lZ/E1v3hw/uYwEEs0YY08P8JvfcEdRUkJfZHk5dyA9PZwLHGjqV1paeHJ4PBbgGiZmIRj7aGsD0sP4RohEZZ63kUimTQvupgF4uyoweXJ0nvOll+jSmTZt8K6joIBTvx54gGboli0MXBUU+DKdPJ7gVo0q/ZrGfmMKwdjH+PHM4guFxxPc9WykALNm0Sff3Bw4UAvQVXPYYXTnDJe+PuDpp/lYQ5mg6enA+vXAF75AJZSR4ftCtrfTzVVZGfi+DQ10a82cOXxZRzHmMjL2MX8+N2DBpvW1tVFx2EYsxXG5gKuvZlrZwBoEVWD3bi7Ql10WnedraOBz5eUFvt3jAZYv53l9fVz4J0/m36lTaT1s2ADU1PT/gjqydncDn/986LiIERSzEIx9jBsHnHwy8Nxz/B0O/G319vK398Uv2u9uRDBrFnDTTUzXrKnx7dxVgYMPBq68kumc0SCUe6qujsHrgoLBFoQIcMABVARFRQwcO8c9HuCQQ4BLLkmuIroUxRSC0Y+LL6Z1/vrrrE4uLOT60NDApJBLLwWOOSbRUhpRY+ZM4NZb6bPfvZuLbHl59OIGDuPG0QXU3R04PW3zZloBPT00QQciQpdQTg7wi18AW7fyi1lWFj2lZZhCMPqTkUFPwsknMzNw40Z6F049FVi4kPE+Y4QhQh9gLP2AmZmc7rV4ceC85oYGntPbO3Tec0EBLZmCAmDOnNjJOooxhWAMQoQbR4vPGVAFqquBTZtoIk6YwGHu+zO/99RTWdm4cycfx981pMpCuUMO8VVEBpIlVF60MSxMIRiGEZgdO4B77uGuHGDgyOPhgn355cDRR0f2eGPHMmZxzz3sripC89Ptpito/HgqhKGor6cysgBWzDCFYBjGYHbvBn78Y+7Kp07tvyvv6ADuuovK4UMfiuxxi4qAm29mDGDtWnZSLClhsOoXv2DgOFAxjMcDtLayRN6IGaYQjLBpbuZvMivL1/vMGKE88ggDvIGCRrm5PP6nPzFXOScnsscWYZVyRYXvmCpw3nnAY4/RneSfntrZSWvllFNoIRgxI2kUgoiUA3gQwAQAHgCLVPU3iZXKAJgA8p//sM+R4zUoLwfOPZftsE0xjDAaGth0Lljb6+xsZgy9+27kVkIgRIALLqAF8dhj/dNg8/JYD3H66eYuijFJoxAAuAF8VVXfEZExAN4WkedV9b1ECzaaeftt4He/4yZwyhRfW5nmZralueACXkwpjCB27fI1tgtGVhbTVaOhEAA+5wknAMcdx11IWxu/eDNm7F8Q24iYpFEIqroTwE7v/60isg7AZACmEBJEQwPwhz/QxZub6zsuQpdvfj4bVx54IDB7dqKkTEJUuaAtX04fW1ERB7dEO7c/VoiE10xONTY7dpfLUtwSRNIoBH9EpBLAfABvBrjtagBXA0CFvw/SiDqvv84Yn78y8Cc9nT2NnnnGFMI+GhuB3/+eBRzp6cyt7+oCHn8cqKoCrroqcp97vJk8mUrB7Q7e7bCnh9XOxogh6RSCiOQD+BeA61W1ZeDtqroIwCKAIzTjLN6Ip74e+N//OJPkiSeYKRisyWRREScxDlWAOqpobwd+9jO+iQMzc1Tpf+vqAm64IbnbNBcUAMceC7z22tDtINraaCLaTmBEkVQKQUQyQGXwkKo+mmh5RhN9fcCjj7IhJcCYodNHbONGejzGjRt8P/9Z56NeISxb5hs3NxAns2b1ak4hS/aF9MILKef27WwZ4ewInAKylhbgxhtpARkjhqQJ2YuIAPgjgHWq+stEyzPa+Oc/mUk0eTLXrdJSZv/l5NBCeO01usMH0tXFc5LdCxJzVKlNS0uHPkeEu+rnn4+fXPtLYSHwrW8B8+axZqC2lpeaGvoJb7qJrbGNEUUyWQjHArgCwGoRWeE99i1VtQm+MaaujnGAysr+nozp05lwUlhID8H779MN7s+ePUwfT2YPSFzo7mYUfqg+PA5OP55UYNw44Jpr6AKrrqa5WFLCL4qllY1IkkYhqOqrAOxblgDeeMPXRcCfkhIWoDU0cGO7fTs9HdnZvH3vXm4WTzgh/jLHHLeb7p/eXi6MgTpw+uO8eU6/naEYqhLXD4+HbroVK1gUXFYGLFjAzyIhFBUFH3BvjBiSRiEYiaOmJvDckrQ04KijgLfeohXR2cmOBjk5XKhKS4Hrrw8cW0hZ3G7ghRfo/mlt9U0MmjOHBRdDTezKyGAVbXV18JW7vp4FVkOwZw+TlGpqqDcyMuiW+/vf2YH20kstJd+IHaYQDGRkDD0lLTOTdUeNjSxKnTiRMYZjjmEfshG1OLndwN13M81q4kSfpvN42Izt1luBr32Nw2MCccYZwB138H6BfGg9PXyshQsD3r2pCbj9diregXrH46Ge6ulh5qp5bIxYkDRBZSNxzJ/PHf9QiNAqmDcP+MEPOPJ27twRpgwAYOlSKoPp0/sXX6Sl0W9TWAj89rdcsQMxezaVQnU1gy4OTmbO1q3sEjpxYsC7//e/PC3QCOO0NCqJV19NnRCEkXqYQjAwdy5jBC2Dqj6IKlvYn3nmCFQCDn19HN4SbAj8mDHUnO++G/h2Efp0PvtZXq+p8WXojBkDfPWrbNAWgJ4eJh8Fm2eflsb3f+nSCF6XYUSAuYwMZGUB113HmiqnG7GTdt7VRWVw2GEceDUUqgw679zJdXHy5CE3wslJXR2356Gq3/Pz2ZJiqP49aWm+fjzbtvENzM9nd9Agfp7WViqFULUcBQVsH2QYscAUggGAHQi+8x0Wp61e7Wtil5MDfPSjtA6GqkGqrQX+/Ge62dPS+s8+v+KKFFEMbnd4fXlcLq7c4ZwXKgXVD+f9DpWk5PGETFIyjP3GvlrGPiorWXy6dy+DyOnp3OkHK0atqeEclfT0/unpTn+3H/0IuOWWFJjFXFhIoUP172lvj2ihj+TpJ0ygpVBQMPR5TU02I8aIHRZDMAZRXMxmk9OmBVcGqsC99/KckpL+O1sRLnAeD/Dgg7GXedjk59MNtHv30Od4PFQYxx4b9acXAT78YXquhmo02tlJwyPSyZWGES6mEIz9ZvNmxkyD1WyVlrLCefv2+Mm135xzDqO2jY2Db/N4mD100kkxM3eOOYaL/ZYt/ROZVFkcuGsX49WFhTF5esMwl5Gx/9TW8m8wn7dz29atKTAOoKwM+OY3gTvv5OKfnU33UUcHFcKppwKf+ETMnt7lAj7/ebrennmG1oITj6ms5G02QdKIJaYQjEF4PNyltrTQHTRjhq9dhT+BXBseD6ttt29n14cxY3yLWkowdSqrw957z9euesoUlmwHywmNEunpdB2dfjoVbk8PW5BPnGjFaEbsMYVg7EOVdVmPPMIOC84C5PFwTczJ4bEZM4Djjx+cPdTSwr5IHR1c2FwuuuRbW1lle/jhgRVL0pGRweKMuXMTKsKMGQl7emOUYgrB2McLLzB9tKTEl0hTU8M6rFdeoVKYNw/YtImtfk4/nT3Pmpu5gL36Ku8z0Mc9aRLv83//B1x7re10DSNZsaCyAYBunocf5qI/ZgyP7dwJvPMOr0+ZwlhrayuHaJWXUylMncpUyDVr6CLy7/jQ1cVj8+bRB/7221QMhmEkJ6YQDADc3Yv40kxVucjn5tL9I8L/N2zgbU7d1apVbLa2bRszMpuafBeXiwW748fz/llZwMsvJ/BFRhNVFmzs3MnaBMMYAZjLyADA3vv+rp6mJsYCxo71HcvKYpzAabGQnu5TAkccwRiD0w+psJDuJH/3UH4+s42GhSozgJYsAdav57HZs9kuoqIi9v4oj4eBksWLqQyc0uwPfQg466wUKcs2jMCYQjAAcJ3z79zQ1TX4HP8qZIf0dObIA4w9BJsg2dc3zBG8fX30az3/PDXSuHEUZulStgo991z22YiVUvB4gD/9CXjxRb5YRwG53Zyn/OabwDe+YdFgI2Uxl5EBgGtYc7PveqB2/r29XND9F3WPh5XNFRX97x+I5uZhVtkuXgw8+yyfbNIkmiS5uQxwlJcDjz8OPPfcMJ4gBMuWURlMm8b+Ev5pWCI0lb773f6trw0jhUgqhSAi94nIHhFZk2hZRhsnnsixwE69gDMbpqmJBVL19bxMm+ZzndfXc9M+ezZz5+vrh643aG+nIlmwYD8F7OgAnnySyiCQtnIaLz3+eHjN5yJFFXjiif6tYN1uBlGeeYb5uu+/TyvhU5+ixTJUDwrDSFIidhmJSB6ALlUdYsbWsHgAwO8ApEL3mxFFZSWVwpIlXHO3baMycFJK3W5eGhtpEWRmAh0ditJxbmxf2YwjF2bjlFPy8d//0m3kZCp5PFQgnZ3ADTf4jkfM2rVc6IMNZMjOZrrU+vUceRlN6ur42OXlvN7XRyWwezcDLY6SyMzkG/fAAwyoXHBBdOUw9o/6elZLqjLOE8y3OYoJqRBEJA3AJQAuA7AAQDeALBGpA/AUgEWquiEawqjqUhGpjMZjGZEhwlbVubnA/fczmyg/n1aD01cnK4vrXn29oji/E8XdezEHH+CuG3LROuN1XHluLqafeyEWL5+A2lo+pipnKZx/PgeR7Teh/FEOqsyNjTa9vXxBjpto2zYqg8LC/jELJ8g8dSqtlQUL6NIyEkNdHfC3vzF/2j8IdthhwCWXpEAb3vgSjoWwBMALAG4GsEZVPQAgIuMBnATgdhF5TFX/EjsxjXiQng6cfTY9M0VFtAhE6B5au9a7CVZFVkcjKnrex9zpbcjKS8dYjxsP7zoZ8956GAtd38JxX74eu0rn7Gu74LifhoV/gUMoYlEO7aRb9fXxjdiwgTINDGD39NAMSk/n5ZVXOEXNiD979gC33UZ3Y3m5z4pzZmT/6EfAt75lCtuPcGIIp6rqraq6ylEGAKCqDar6L1X9KIC/x07E/ojI1SKyXESW19XVxetpRw3Ll9NFP3MmZ8nPmsXfzwEHMPB8yIS9OD17KcZmdMKVnQGIINPlQVoa8GpXFVBUhLS7f49JuU2orIySMgCAgw7i4tsXxFPpdlP4WbOi9KR+5Oezn9Hu3bQW2toGp0yp8s1ypq6NG8dpQ0ZiePBBpstNntw/hS4tjb3ZRdi/3WI9+wipEFS1V0QOEpFTRCTf/zYROdM5J1YCBpBnkapWqWpVSUlJvJ521LB5M5N3HHp6uPZlZdF9P7F1A5CeAaSloauLm6+ODiA/vQsrdpUBeXm805tvRlew8eM5h2DbtsA/YFXedtJJXLxjwYc/zOdpbu7vPnKev6mJi49/8YYtNolh1y5WVk6YMPQ5xcWsaamujpdUSU9IhSAiXwbwOIDrAKwRkfP9bv5xrAQzEkNaWv9MIWc9EwHS+nqR174H3em56OxkN07nUlOjqN0qdPWPG8cUzWhz2WXAgQf6WrE6AjY389icOcBFF0X/eR0mTwa+/nX+39vL5+3qoizNzbx9/nyfomhqomVjxJ+amsFKeyDObTU18ZEpBQjHZfQ5AEeo6kcAnAjgOyLyFe9tUa0AEpGHASwDMEtEtonIVdF8fCM0hx7avyjNqTvo7QVEPVAVNDcLurtpNWRn89LrykKhpwFLlwKNren9J7xEi5wczvj87GcpVE0NL3l5HBZw3XWhp9QPlwMPBH7+c+Dqq+meystjAPnEExlAdsZv9vXRUjrxxNjKYwQmkn7rwdyQo4xwgsouVW0DAFWtFpETAfxTRKYiygpBVS36lmDmzuUa19ZGz0taGuMHa9cCmWMz0NHjgrvbjbz89H3lAB4VuDUdR0+oQQaANW+240OfmokA1QLDJysLWLiQ/bc7O7nLy86ObwvVnBwqhJYW+timTOnvo+7tpdl05pm+eIIRX0pLaT2qhv5uBHMrjTLCsRB2icg854pXOZwDoBjAYTGSy0gQWVnAF7/ItO2GBv6epk5lYW5DUxre752OAlf7vqSfPhXs6hqLeYVbUJbVhOwshXS0Y2PFKbEV1Om25wxpiDfZ2SysOPJINmiqrqa1Ul3NVMePfYzZRdbrOzFMn86U0qamoc9pbaV709x6+wjHQrgSgNv/gKq6AVwpIvfERCojocyeDdx8M/DXv3J9S0vjRnfVKmBn9nSUajPSOz3oceVCRPGhog9wfMl6CBRjWrahdtxM1HYcjBjk+iQXjqvqxBN9eblTptDvFkmarBF9RFgx/pOf0LVXUND/9vZ2VkzeeGPgyvdRSkiFoKrbgtz2WnTFMZKFAw8Evvc9Ju7s3cvfTE8P8POfZ6OgewYq1z6JUs9OTC9oQE5mHzLaOuDq68be4oPwUsU1mO8Z4X0TnfFyTzzBCliXi37ruXNZxDGsKjwjKhx4IJMAFi2i9eYs/G43a0Wuvz6hU/GSkRH+qzWGg4hvGA5AxZCTA0w4sBR9sy+DZ9dKdG19HZ7edrTnlaK24ng0FM1ES23avolrIxJV4O9/ZwWf09nPGRy9fj17iX/lK5wMZCSWQw5hEsB773E6kyobcs2eHbwNyijFFIIRNsXFrPjfsAEoK8vEjskLsGNy/251vb30nFRVJUjIeLBqFfDUU2wA5e9uSEsDyspYmPH73wN33DF4nmgonM6pFnuIHunpTEmOdn+rEUjYCkFEBOxnNF1VfygiFQAmqOr/YiadkXRcdBEr/puauNZ5PIyhbtzIv21tTAKqrqYrPS2ctIVU46mnWHw2lO85N5dvxptvAmecEfrxWls5dOfZZ2mGZWVx4M7JJ/vMM8OIA5H8XO8CcAwAJzW0FcDvoy6RkdRUVADf/CY3sJs3czzAiy/6JqEtWMAEnDvuAP7v/+iuHVF0dLDN9fjxwc8Ltzhv1y4Ga/76V19TvOJizjT97nc5/Mcw4kQkLqOjVPVwEXkXAFS1UUSGM//KSFFmzOCC/4tfsED4oINoLUya5KsLKy4GXnuNfz/60YSKG116e2kZhHLppKezVWwwenqAX/6SlYD+QZeMDFY9d3cDf/wj2zXPnDl82Q0jBJEohF4RcQFQABCREgARlAMaqUBtLfDSS0yg6e3lunTGGezI4N/LrauLsYQTTvAV5/qTlkZvxzPPcNTwiMnCzMvjG+GUag9Fayt9ZsFYtYodOSsrA9+elcU37qmnGKQeLnV1lCsri0omWfx5TU1sqQtQrkjjLkbUiEQh3AngMQClInIbgIsAfDsmUhkJ4bnn6LlIT2ehJ2cfAHfdxSzKG27wpXO/9x4r/gMpAwdnsM66dcARR8TnNcSc9HTg1FN909sCoUrX0sknB3+sV14J3YivpARYudJXOr4/rF8PPPooNbjTrKq0lDOojz02cQHs+nrgn/9krMV/VsGCBQxWWfPKuBOWQvAGlJcCeBvAKWDLio+o6roYymbEkRUrgD//mbt6f0tg3Dhetm4F7r6bM+RFuN6p+iapOe3/A9HREZeXED9OOolm1N699In5o0oza/bs0G24m5tD915yBu50du6fQli2DPjDH6jJnfRYgG037rmHsiaiorqujrMK2ttphjoB+r4+DrNZv56zCsrK4ivXKCcshaCqKiL/VtUjAKyPsUxGnFEFHnuMcdKBLf4dJk+mVbBlC62F5mbOGFm50ndOeTnjC/7dn4ER5C5yGD8euOkm4Ne/ZjpVbi7NoY4O+tkOO4z9P0JVwI4bx4Vx4FxRt5suKREqDNX9exP37mW//4kTBw8NKiig++uZZ6i84p2S+cADVHKTJ/c/7nLx2K5dHN3nZDAYcSESl9EbIrJAVd+KmTRGQti9mxvFYH3YRKgs/vc/rjOPPMJeR8XFtAw8Hhbsbt3K9j4TJ3JtzMjgoJ0Rx+TJwI9/zJYVb7xBl05ZGV0w06aFt4idcALw7rs+10hHB4unqqv7d+s88cT9mwL32mtUJkPd12np8PTT8VUIzgi+YNWLZWW0ErZvt4lmcSQShXASgM+LSA2AdtBtpKpq1R4pTnu7zzMRjKwsppo+/zzXQyewXFjI+48ZQyXw1ltcw+rrgfPOG4EWgkNGBquR97ci+dBDmZq1axd366++ysyj/Hwu1r29DLhu2cL2C07L7XB5883Q6bFFRVx4u7piM3o0EFu28G84swqqq00hxJFIFMJZMZPCSCi5udyQBusU3NkJ7NjBpBiXi2vHwQfz+LZttB5ycnhbZyfw9tvA5ZcD558f+PEMUKHccAPws5/RdePs2D0e+uQA4JhjqH2XLaOvLpxCN4eentAKxPnA4zkTIJJZBZGcawybsBWCqtpYoRHKhAlcc1paBvv/u7o4iXDbNnpFHHf2rl10lR9xBF1NmzbRlQTQXTRxInDVVcmT2Zi0lJQAl1xCF0pbG8219HQOoZg61RdInjCB6aennBI8tcuf8nIW0fnPRB2IE6wOdk60CTd7SGRw0N6IKZG0rvhuoOOq+sPoiWMkAhHu5O+8k54LZ73p6mJmZGenr7NzUxM3se3tvO3YY+nu9U8G8XhoTZgyCJP33uObO2nS0Ofk5lLjbts2dN3CQE49lRk7wUy/PXtYORjPD2vmTC70LS2D21I7OLMKQmVqGVElkm9Bu9+lD3QhVcZAJiOG9PQAy5ezTfyXv8zuwI89xs3oxz/OoPDOnfQgrF1LBdDXx03k0UdzXXK7+Tc7m4810Kpvb7eNXUR0dITXeTMtjXGFcDnoIJpxtbW+4dj+7N7NGMPCheE/ZjRISwOuvJJBpvb2wbd3dFD5XXmlzSqIM5G4jH7hf11Efg7gP1GXyNiHMz/e7eZGaqiU0HBpaQF+9SsGhseO5SLvdrOl/+LFwOc+B3znO8B//8sElfXrWb904IHcvGZk0I29Zg1lycqiwtizp/8Uwvp6/paNMJk4kelbwVClZi4s5P+bN/sCOpWV/KAG4nIBX/oSm0q9+y5Nv+xsKpXublolX/7y0Lv0WDJnDquv//hHpt469Rjd3XRfXXedtQ9PAMNpf50LIKpTQETkTAC/AeACcK+q3h7Nx08VPB5m6ixezKw7gAvwySfTCxAqcWSox/ztb2kBTJvmO56ZyRhAZycLz77zHQ4BO+44tpEfmBlYXs7Oph0dtBKcamZHIdTVUb4jj+x/v+ZmJoz09dF6KC+39PJ9HHUUzTSPZ2jXTX09d/x1dex/tHNn/zdw7lzgiiu44G/ZQk0/fjzf6C9/mR/8smXceefn8wM68MDE7sAPP5yZVitX+mYVHHAAX0uogj0jJkQSQ1gNbx8jcMEuAXBrtATx9kn6PYDTAGwD8JaI/EdV34vWc6QCHg/rcV56iRmBzsLZ08NElFdfZU1UMHdzIDZs4GWo1O+cHMYPnniCiS+qgdcmpzPzsmW0DtxuxhoaGuj2LSoCvvpVXyy0tRX4xz9ocfi/xqlTgU98wlzEABiAWbgQWLKEu/2Bb3x7OwPOhx7KjKTCQr6BjkLweNgX6bLLGLDNyOBtfX0875JLmBIWrNAkUWRlUTkN3EEYCSESC+Ecv//dAHZ7ZytHiyMBbFTVzQAgIn8DcD6AUaUQXn6ZymDatP7rgrOT37sX+M1vWBMVyebu1Vf52wu2Ky8uBlav5m6+rIzrTKBNa0EBk1127qQnwul0etJJ3Nw56extbcDtt/M8/+4EqkBjI2+78Ua6uUc9l1/OBfzVV+naKSjg9ZYWfvjXXgv86U/8kAa2sOjro1WwfTs/LGdxVaXW/ulPOS7SXDBGCCIJKn9JVWu8l+2q6haRn0ZRlskAtvpd3+Y91g8RuVpElovI8rq6uig+feLp6+MOfcKEoT0HxcV0Ha+LsIuUM/4yGGlpvLS1caN52GF8rkCkp/OcBQvoor7pJno+/Gub/vMfZhtVVPRXXiL0ZhQVsc1OqC7Ro4KMDObp/vCHrGAuKqIWveIK+u7S0mhuBepntHEjNeyECdS+XV08LsJMnZISvtGdnfF9TUbKEYlCOC3AsWgWqwXauw5KjVDVRapapapVJSOsG+KOHdzQ5eUFPy8zk9k9kVBQQLdTMJy4pbOoX3wx/9bXDz63s5Mb0ssvD1zg2tFBSyeYays/n94Q/35IoxoRas8rrgBuuYWdBE8+mSXgGzYEziro62OAOT/ft4tobe1/Tl4elcTbb8f+NRgpTUiFICJf9MYPZonIKr/LFgCroyjLNgD+8wKnANgRxcdPenp6wksHz8gInK0XjA99KHTX0cZGNqdzgtaTJwM338y1prqa2YvbtvH/1lbgC19g8DkQO3ZwrQqVTZmdzTR8IwRDVey2tfnazToESjHNy6M/0DCCEE4M4a8AngbwEwA3+R1vVdWGKMryFoCZIjINwHYAlwD4RBQfP+kZO5aLaLA6IoC784kTI3vsQw+lR2HPnsAZik7bnKuu6v/cU6eyS7ETlO7r465/zpzgiSBOa+zaWrrBXS56LoqK+j++iHUnCIvp0zlzeSD+i7/z/8DuqYC90UZYhFQIqtoMoBnApSIyDsBMANkAICJQ1agMffXGJK4F8CyYxXSfqq6NxmOnCsXFTAapqRm6ul+Vv+ujj47ssdPTGVf82c98j+/0MNqzh0rm4osDN71MS2M2ULgZQarcjL7xBi0Apxvq++/T2liwwNcio6urfxqsMQROtN7J93Vw/vd4aDZOnBg4WNTRQaViGEEIO4YgIp8Fh+Q8C+AH3r/fj6YwqvqUqh6oqjNU9bZoPnaqcOGF/F0Hcu+o0l1zzDGRp50CtBC+/31WJHd3UzFs28bg8S23AB/+cHRqA559lmn106bRMhgzhgqgsJBusVdeocvJ6b22YMHwn3PEk50NfOYzbCLl7y/MzGRucl0d38xDDhl8X6e6OdJdhDHqEA3kbwx0IuMICwC8oarzROQgAD9Q1YtjKWAwqqqqdHmk0dUU4J13mBTS28uF1OXyLaBHHkm3znDrdlT5eOnp0a1NamlhHUNZGR9/6VJfQzxH2Tj1ChMmAJ/8JFNYjTBZvpyj7VpafC6iri6mnR58cP/6BIAfwtat3AWce25iZDaSDhF5W1WrBh6PpA6hS1W7RAQikqWq60XEyopiwOGHM9PwzTd9w+5nz2Y2YrizV0LhDOOKNk5vo8xMXo47jsecbs5paYxD1NQwtT7U2GFjAFVVrCdYt469iFwufikyM7mLqK3lh+vMU8jIYAXgmWcmWnIjBYhEIWwTkUIA/wbwvIg0YpRlAcWTggLgtNN4SSW2bOnvwi4oYMFaYyNrITwexhF6e7mhtfYVEdDayo6Dzc18E6uq6Idz+MEP2AJi3Tr6BCdMAObPD53HbBheImlud4H33++LyBIAYwE8ExOpjJTF5RqczOIUovn3YKqttfbYYdPbCzz6KEfVud18Q53eIgsXApde6itDP+AAXgxjP4ikl5EAuAzAdFX9oYhUAJgHIESbRmM0MXs2C9KC0dNDT8b+BMZHHR4PcN99bAZVUdG/3qCvj71OGhrYwC7cwTmGMQSR7NHuAnAMgEu911vBZnSGsY85c+jNGFgsC3BTq8qitZNPju+QrpRl/Xoqg8rKwQu+y0UlsWIFm0oZxjCJZEtxlKoeLiLvAoCqNorIMDv0GyONzEzgmmuAO+6gG7uwkJmSGzdyI9vZybWtsjJ4t2fDy3PP9W9LMRCnX9HTT1v+rjFsIvk59npbVCsAiEgJACt9NAZx8MGsayguZsvul17yzXI59FAmxfz+92zzHc/Z7inJhg1c8INRWMhofrwqkVWp5Tdv5t8wU9eN5CcSC+FOAI8BKBWR2wBcBODbMZHKSHlmzGCMYMYMrmcuF2sqnP5sHg/d3xMmsCDOGAIngJwMqNI19fjjvqwAj4duq498hOmwljaW0oTT3O7P3n+LAXwD7Gm0E8BHVPWRGMpmpDB793KIzqxZXPRLSvo360xLY/O8J5/s3/66tZXV2Fu3RjY+eMRyyCH0tQWjoYFvdKz9b08/Dfz610x7rahghXRFBa//6lc0B42UJhwL4QgRmQrgMwAeBPCwc4OIjI9ygztjhLB69dBT1xyyslhku3Ej3Uv/+Q/7Hzmb4pwc4IwzgNNPH8UTFU89lRWKfX2BS8qdwdtXXRVbObZs4ei78vL+LWxF6LLKywP+/nf6CysrYyuLETPCUQh/AOsNpgPwb6guYDxh1HTM6upiUDQrq39/MWMwTofTcNiyBbjrLqajTprku19XF/DPf7IW6/rrA89dGPHMnEml8NxzwJQp/TVjTw+HUhxzTOzHzi1ZQhNvqH7mGRm8/cUX2XPJSEnC6XZ6J4A7ReRuVf1iHGRKOrZtY8O2ZcvoMlVlAehZZ/H3moq43Vxo33iDvdLKyjgzobIyOm5gp5V3KFSBf/+b1sDkAfPxsrMpz7p1wOLFwEUXDV+ulEOEs5KLijhOz5mGBnARPu884Pzzo9uQKhD/+9/QLXgdSkp4nimElCWkQhARUTKkMnDOia5oycHq1XSbulz0hTutnNet4wCqT38aOPHEREsZGdu38zXV1XEhzsjg63nuOcYFP//54VtAc+f65rwPtVZ1dvo6nk6ZEvgcESqK558HzjlnlFoJaWnA2WezC+D773MoTm4u4wbxKubo7Q2tdJz+SVHA4wE++IDxJI+HnqqDD7bau1gTztu7RET+BeBxVa11DnprEI4D8EkASwA8EBMJE0hDA/Db37Llgn87mLQ07qi7uzn3fOrU1Onp39DA4faqg129qsCqVXTf3Hjj8GKU48ZRUb74YmCro6+PBWqVlUPPbXbIzOQ6U1sLHHjg/suU8mRlBR5YEQ8mTWLE3xlkEYjW1sFm3n6wcSOwaBG/FyK+2T6FhTQ+EvUWjAbC+cmfCaAPwMMiskNE3hORzQA2gFXLv1LVB2IoY8J4/XW6VobqDZaVxcXqhRcC3+7x0N20aVPoRS9eLFlCF1Fx8eDbnJG+a9ZwIzpcLr2U/de2bKE14nbTIti5k4v72WfT5RaOt0OE9x+x7NlDv9iiRcBf/kJ/XjIVaZx5Zuhsp8bGYXdV3bKFG5bubm4Wpk7ld7Kykt+TX/7SJoHGknBiCF1g24q7RCQDTD/tVNWmGMuWcF55ha7bYJSW0g//mc/4FjaPh90GnniC6ZdOy+eZMzkA56CDYi97INxuKq+ysqHPEaEXYskSmujDITMT+NKXODP5uee480tLY/zllFPYg23JEs5MCIYzJc6/Od6IobcXePhhYMkStLuz8HbrTNQ2u+DyLMWhM57HId//ONIrkqDp0xFHcHXevp3Wgr/J5/Qjqahg7/b9RBV48EF+/wLV4jmTQe+7j+3hYx02GY1E5JFT1V6wBmFU0NUVunOw093T7eb/qsBDD3EBLC3lbwTg8Z07gZ/8BPjiFxMzvKqtjTv0UCmc+fm0bKKBy8UEmKGSYI44ghvigXPi/amvp6towoToyJQ0eFdAfellvKgn4W/vzUGvJw1Zrj4oBM8u60Xhee/jmkU5mHlkiGrlWJOdDXz1qywx37CBH1ZWFrfybjd3O9dcM6wgz9attBCmTh36nDFjOEtj/XpWvRvRJSlCNCLyMXAc58EAjlTVpBiDVlJCV0dmkI5NXV2M7znnrFzJAOi0af198CK0NnJzgXvv5e8nlPURbTIyaKmoBs8k6uujUogHY8cyUeZf/+JCMFAptLXRxfXxj8dHnriydSvwyitYgpNw/6rDUV7Qgqx0PzfRGKC5rhc//WY9vn3/uMSn948dC9x8M32gb7wBNDVxK3/00ZzXPMz0tJ07fTGDUGzfbgohFiSFQgCwBsCFAO5JtCD+nHoqh1AFayWzZw+z/pxiqief5O9mqIBsTg4timXLmDUTT3JzudPeuTO4MmpsZEFYvDjvPL4nTzzB9zEvzzczPjeXG9MZM+InT9x45RV0SB7+9t6cwcrAy9jxLvTs3oq/PzQV37xliBqAeBLDmQvh6pNQBY/G/rNfCkFEJqjqrmgJoarrvI8brYeMCvPn0126a1dgd0VDAxeshQt5vbOTfnLHTTQU48ax+DTeCkGEgdxf/IIZG4F8sB0d3KUfdVT85EpLY2zlhBOoKKurac3MmcPPYMSmmtbU4J32WejtSwuoDAAALheKM5uxbpUbu3ZljDy3mR8VFb4W6UMtBU5yezC3krH/7K+F8BSA/Y8epQhZWdyd/vKXXKTy87nD7+lht4DCQuBrX/NZEM4wq1B6zeXiYySCuXNZUPf008w0KijwpfXt3Uuldt11/SczxouiovgryYSSkYFtLQXIcAXPJhIBXOn8fMJWCDt3ss3sq6/yQy0uZg+Qo4+Onz8wQiZM4ICljRuHfp2Njdyk2VC42LC/CiHirbyIvAAg0Md8i6o+HsHjXA3gagCoCLUVjwJFRcD3v89UzCVLaBUUFQEXX8zdq39dUF4eLYauruC72tbW2HcaGAoRpoNOm0YXTW2tLzB+2GF034xI90wyUlWF9CfXwqNBfk7d3UBuLjQzK3w3yZtvAvfcQ9OrpIRf2I4ORu+ffBL4xjeAiROj8hKizRVXAD/6EfXZhAm+zZUqFWJvL2tkksyZMGLYX4Xwf5HeQVVP3c/nGvg4iwAsAoCqqqq4VEdnZHDxnz8/+HkuFzdhjz02tEmryt/mySdHX85wEWH7m6OPZgyku5uWQiKsglHNggU4uORlLN47xBwDVaC9He65RyDNlRbSFQmAaTp/+ANT3Px3K/n5vNTV0Wd4221J2TGwrAz49repu9as4TEnPnfAAVQYcdgHjlr2VyE8GlUpRhAnnEBLfffuwfn+qkyZmzcvOSpuRYLXJBjDw+1mDcYLLzAOlZ1NRXzMMV7lm5+Pg276CIqv3InGhmy6Hp2tb28vU6ymTMEOVzlOXBimp+fZZ5nyNlRLi5IS+j9XrgSOPDIqrzPalJXRVbt7N9OfVWnQDCx/MKKP7E8LIhF5R1WjFkMQkQsA/BZACYAmACtUNWSeS1VVlS5fnhQZqv3Yswe4805+mbOyaGF0dXGBqKpip+KRPE+4r48/3NGcCdLaCvzmN0zZdzbnbjddjhkZwLXX+lowbHlxC26/uQlpTY0oyWlFmgDIzETvtAOxI7sSk6e4cNNNYSiEri5WAk6eHLxqq6GBzaO+8Y1ovVwjxRCRt1W1auDxuMUQgqGqj4HT2EYEpaXAD3/I9g//+x83emVldNFMnjwydzk9PWz299RTTK8XYaXzmWcyUDialIPHwx5YW7YM7uM0ZgzTaX/9a+B73/P2wTp5Gr79T+CR+1qxeqUHaRlpQG4e0tLTcPJC4IILwrQOOju9EegQJbxZWawhMIwBxC2GMNpIS+OCONz2D6lARwd3w+vWsb2EEz+prWWLgRNOAD71qdHTamDDmm588FozpvZtgdS6GaCpqNiX0pWXRwviySe5oQfYzfPG741BXR3d/GlpPBaqUr4fOTn0rwRrMQswaFRaOqzXaIxM9kshqOpd0RbESF0efJCukWnT+u+Gi4upIEbV7OQNG7D0+reQvX0iZGwnV/b6elb3TpnCzASXCyUlwPLltB79d/8lJaHHDgxJdjYLSN55J3gWUUsLtXS4tLVRS4nwgxyxhSFGslQqGynKnj3MciwvD+wK85+dfNppwduApDzbtwM/+xnquj+CnHHZQLb3DcnO5s5961ZeP+IIuFwCkcEKYdiccQbbSnR2Bg5U7dlDjTN3bujH2ruXc01ff91XEeZyse/K5Ml8XdOm0Sc41CQ1I6UwhWAMi1Wr+Dfc2cmHHBIfuRKCt/dG3hjBjoYBLhtn9vC2bcDMmdCCsfB4YpD5WVlJP9Qf/sDrpaVcrDs6aKmMG8dE/lBPvHs38OMfM+DhTIbas4dBsRdfpBZzpiDl5wOf/SzT54yUJpyJaeE0HfaMhnbYxmBaW8OPDXR0xFaWhNLaysVy8mR8SLfh3V0TUTxw6pyTerV1KxonjcWMGTGq/ViwgO6pl1/2VSoXFQGXX06XUiiTRJWFbT09vlF2e/fSUsjJ4bHmZpYNH344lcavfsVcUZtek9KEYyHs8F6C5ca4AFi5yChk3LjwZycnaceE6NDcvC/DZ+6E3Rif04n6jhwU5Xb2Py8jA+6mVjTlcoZGzDLOJk4ELrmEl0iprgY2b/ZlB6gCK1bQReRYFmPG0AV2yCGMfBcXAw88ANxxx9A7hMZGzk1wCgvi3e7XCEk4CmGdqgat0RWRd6Mkj5FiOBvCULOTCwpGeP+Z9PR9fvZMVx9uOPoN/PS1Y1HbXICyvHZkpffBo8De9ly06ThceG14bvyE8MEH/Otoq8ZGBjv8x2empfH1NjZycXcGFbz//mC/4N69wCOP0IJy7qfKAPvFF1t1ZBIRTnb4MVE6xxiBjB/P2cm1tb64oz/O7OTzzhvhA9JLS7lLbm0FAJSPbcEPT3oJ5xy4AU1dWahtHoutLWNxQM4O3HRjz76W6UlJT09/7d7ezr8DBXZ6SjiosiTbn7o6Nid65x26msrLmYJbXs7eFLfeysZFRlIQ7gjNgIjIp1X1/mDnGCOfSy9lJuNbb9EtNG4ci7Pq65nyfu65/Xs3dXezc8KKFezQUFHBdg6B5jynDGlpzKu99166UNLSMD6nExcevA7nz1qPjt4MZLQ1Ilu6gQsujHJpZ5SZMKG/HzCQ5nJ2+QMzmQaaiQ8+SBNx8uT+x9PS2Itizx6+Z9/+dhJryNHDcPdsPwBwfzQEiRduN61cJ+ljRO9a44QzO3ndOk6Lc2YnL1hAReA/TGv9euB3v6MHIjeX5739NiemnXUW77N5MxVFWRmnYiW6B1tLC70dy5ZxbZs4ka/roIMGrH/HHceCjJdfpsXgHQLsUjfG1G/nOd/8ZuJfUCgOO8w3HjMry+cq8h9U0N3N1+dExR1LwX+s265dwOrVwYcXlJSwRqO21oYcJAHhZBmtGuomACnj/OvoYLbcs8/6sl3y89la4cQTR3ZvoXjgcjEdffbsoc+prmbMcexYDBoH2dLCedOFhVwXnJbcubmMix5/fGI2kGvXsg1Fd7dvA7FuHYvKZs0Cvvxlv2C5ywV8+tPsXPjkk/SpO4O2jz6aFsSkSfF/EZGSnU3f/v3307UzZgwX7oYG/t/bS804f77vQ6mro+b3b0VaXR16QIhzW3W1KYQkIJz9cRmAMwA0DjguAF6PukQxoLUV+NnPuAmZMMGX3NDRATz8MF0dX/1qhG0CRiBtbVzoli/3uXKOP37oorNI+de/uOEsKOh/vKODGY0uF623o47yKeiuLnoU3O74twzfupXDkcaN6z+wJS+Pa/ymTZw5//Wv+9VhuFwcoXfccVwk3W5qwGRJsXL8da+/7qsxOP54Rvz9i0lOOolfgn/8g5q5vJw7/h07qBSOOoomnMdDt4/LxVoE/y+KZ4i23oEIJ1XNiDnhKITFAPJVdcXAG0TkpWgLFAsefJBxq2nT+h/PzeWmprqaiuGzn02IeEnBqlXAXXf5PAEuF103zz/Pte2TnxxeMerevYwhlpcPvu399xnHLChg9ub27b6MpOxsup//+le6k7xemLjw5JO0CAKt5SKMka5bRxfZoHbmaWnJlz1TU8N6gaYmvqiMDO6SXnmFTbeuucb3YkVY9Xz00fSXbdpE/922bfww3W7e1+NhutQllwxul1FaGjjTYCDWhz1pCCeofFWQ2z4RXXGiT10dd7yBFiKHyZO5YbrootE5JGbTJq4TxcX9d8Jjx/L3vnSpzxsykPZ2unvS03n/oSyJhgaukQMrmru7uRN31qH0dD6eP1lZ3EC+9Vb8rIT2dj5fMA+PCGVbujQ55lsEpa6OZrLL1d9fN3YsF+3332dw5+tf7x8YGTuWPUdOO813rL6eWhugEhiq+dL06fxCNTf3T1n1x0lnPeigYb08IzqM+JDqBx/w+x6stYLj5v3gg6SdGRJTHnuMLppALrO0NK4fS5cy6OsojB072Op62TJeV+Vt55zDTeXA99svTb8fTkajc77HEzjQn5vLnXi8FII3ezRkFXZeHrs8JD3//S/9b4F2RiI8vm5d4DqCgRQVhVdUlpYGXHmlr1htoKnV0UFFdf31o6cVbpITsg5BRN6JxjmJors7vPNUEzf4PpHs3cvAabAOm87O/s03eX3TJuAHP6AnYdIkriXl5Vxv7r6bLrqB7uMpU+j+6RqQoDwwlb2vL7D3IJRSjzZZWXwNoTwePT0pEHvq7eVA8GBuGRFq3RdfjO5zH3IIeyd1d9M3u307dxPV1bQOrrsu9GxaI26EYyEcHCTTCGBweQh7MPGMGxfeeU4a6mijqYkLbaigcXY2f8ddXRzukpvb3wsgwhhAfj43ozNnAsce67s9M5Pzph99tH+b7Px8Pn9fHxfXnJzAyqmzM76zJQoL6fHYuzf4d6itDfjQh+Im1v7R3k6lEKrVbH5+bIrEDjuM0fk1a5iWC/BLMGdO8qfgjjLCUQjhOPeSNkXgkEO4yDgp1YHo7ORvYdas+MqWDGRmhhf3c7upBFaupDtlYNqoQ1oaF/TFi7lQ+iuas87ierB6NV3POTmMa1ZU0EopKGCB2kBLoKODn93hURvaGhoRZon++tcMZAdyYzU2UnEkbQsKh4wMn7kTTPO73YNTwKIpw/z5Zg0kOSGNcFWt8b8AuArA1QCOBJDpPb4t1oLuL1lZwEc/yuQIt3vw7b293Pl+7GOjs6X7pElcA0J1Iu3p4YL8xhuhMyjHjGGGYl1d/+NZWcBXvgJ8/ON8vtpaX0B5+nQGZgdmETU300f/2c/Gv1Zk/nzgIx+hnHv3+hRnTw/ldruBG25IgU1uXh6Dtg0Nwc9rakoBc8eIJREHlVX1uyJSBmA+gI+KyAxV/dxwhBCROwCcC6AHwCYAn45mO+1TTuEC9Nhj3H06m6DmZv697DKmYieK9nbuNl0uZurFM76Wns6d8IMP9q8o9qe+nhlEBx/MQHKo6m6ny3Nv7+DbMjMZeD7jDHon+vp88cmHH2acwt9iKSsDvvY1eh3ijQjnGc+cyde9bh1fV0YG3V+nnJJC7TbOPpvzTAsLA3/B2tqo2RYsiLtoRvIgGo6/AICI/BrADRruHSIRQuR0AC+qqltEfgoAqvrNUPerqqrS5cuXh/08e/awPfz69bx+6KH0cyfqR71nD3PdX3uN1z0eKquzz2ZdULwslr4+YNEipt76dVxAby93+jk5wE03MTD8l7+wM8PA1jQDH2/HDs5ZjrQeq7GR9Q+Oopg2Lb7B5GB0dPiCyClnTaoygPP44wyKFBZS4/X18YvodjP4e+ihsZOht5dvYmamtQZIMCLytqpWDTweiYXQBuA/InKJqrZ7F/Hvqeqxoe4YClV9zu/qGwAuGu5jBqK0FLjwwlg8cuRs28ZWDd3dvoFUAK2Fv/yF8bdrr43PyEmXC7j6asZbnnqKLhJnl3/SSdzNO4He444DXnghuDt69+7w5rAEYtw44Igj9v+1xJLcXF5SEhF++adNY4Bnyxafpl2wgLsQ/7YT0WTvXn5pliyhUlCl4jnrLH7prKld0hC2hQAAIvIJADcA6AbQDuBHqvpKVAUSeQLA31X1L0PcfjUYw0BFRcURNTU10Xz6uNDXB9x8s2+Q1UBUmZV30UXsFBpPPB66mp2OCwM3cqps1/DWWwwsD/wtt7TQ+/C97wW3IowE4swx6Omh1o5lW43qahbEdXfT/5eZ6WuF29rq+5KbUogrw7YQROQUAJ8DFcFEAFep6vsR3P8FABMC3HSLqj7uPecWAG4ADw31OKq6CMAigC6jcJ8/mVi/ngHXoXp5iTAL55lnuDuP52D6tLTgLjQRX4uP5cvpOsnLo5JrbeXa8vWvmzJIakQ4yCLWdHWxBD4jg+a5g5OKNm4c8M9/0mpJRJDIGEQkLqNbAHxHVV8VkcMA/F1EblTVsCpZVPXUYLeLyCcBnAPglFjEKZKJlStD+6Czs+na3boVmDEjPnKFS3Y2297U1LANzvbtPHbUUZyzbu5hAwAHXjQ3D52jnJ5OM3Tx4pGtEFpa2AbBadg1a1bSBqHCVgiqerLf/6tF5CwA/wIw7Dw1ETkTwDcBnKCqI3kUOwBunMLJJBIJnCqbDIjwdz7Ub90w8Oqroesaxo9ncUqwfkepSlcXu8W+/HL/0v38fObCn3BC0rnK9ruXkaru9LqRosHvAGQBeF74Br2hql+I0mMnHZMmhW6pocrv0GisnjZGCO3toXfCzryEkdY3pqeHVY3r1zM9zz9Xu7MTuO8++ljjHSQMwbAS+lS1MxpCqOoBqlquqvO8lxGrDABfA71gLeDr61lLZF2BjZSltDR0xWNfHxVC0jeEipDXXmP5/dSpgwt3cnLY/OvRRwfPoE4wSZLhPboYP56FTTU1gZVCWxs3VxfFJPnWMOLECSdQIQQLCTo5yimbzxsAj4cFRmVlQ7uEMjIYXH8lqkmaw8YUQoL42Mc4vnPrVl4aG5muXVNDZXDjjckXTDaMiJg1i/1Itm8PrBTa2rh4nnVW/GWLJa2tNPFDpfMWFrLgKIkY8fMQkhWXC/jEJ9jf//XXma6dns5+QYcfPrI2TMYoxeVie+s772TgOD+frqHeXvZNyspiM6gpUxItaXQJ1UTQYWDv9yTAFEKCmTAheaqnDSPqFBSw78m6deyLvmsXd8Yf/jCDabHqrppIxoxhxlR7e/DYSFNT0pXlm0IwDCO2pKezzmAk1xr443LRDfbQQ4MHuTv09TGnfOHC+MoWAoshGIZhRJvjj6cyqK0dPD6wp4c+4rPPDj60OwGYhWAYhhFtcnLYt/3BB9n4y+PxxRWysoBLLqEVMVIK0wzDMIwg5OcDX/oS0wfXr2flcmEhO70maX8XUwiGYRixpLiYfeNTAIshGIZhGABMIRiGYRheTCEYhmEYACyGYKQoHg+waRNre9LT2eZjJNY4GUY8MYVgpBzvvAP87W+cOgf4Oigfdxxw8cXW9sMw9hdTCEZK8dprwD33cAKj/whStxtYupSNAr/+9aTN6jOMpMZiCEbK0NIC3H8/izvHjOl/W3o6FcSmTWyZYxhG5JiFYKQMb73FFjDZ2UOfM3Ei8MwzwBlnJO3Y2tSkpQVYtQpoaKBPbvZsdmY0RhSmEIyw2b4d2LKFi3JxMdvdDxwGFUtWrRpsGQwkO5uxhbq6pGsTk5r09QH/+hfw7LP83+XyTXWaPx/4zGdCfyhGypAUCkFEbgVwPgAPgD0APqWqOxIrleFQV8cRsOvW8boqhz0VFABXXAFUVcVHjhRuM5+aqAJ//jPw4otARUV/7a9KDf3zn7O9tQVtRgTJEkO4Q1XnqOo8AIsBfDfB8hhe6uuB224DNm+mj76ykk0cp06lS+bOO4Fly+Ijy8yZHLIVjJ4ebmKLiuIj04hmyxbgpZf4oQ80BUU4F7i6mhOejBFBUigEVW3xu5oHwPZ3ScK//81FeOLEwbvz/Hwef+ABoLMz9rIccww3pr29Q5+zcyen0AWLMxhh8tJLQGYmzcGhKC3l/OCBLZ6NlCQpFAIAiMhtIrIVwGUIYiGIyNUislxEltc5iehGTGhp4eYvWOwwJwfo7mZtQKwpLgYuuIAt5ru7+9+mSmVQVMRZ1UYU+OADducMRl4eqwM7OuIhkRFj4qYQROQFEVkT4HI+AKjqLapaDuAhANcO9TiqukhVq1S1qqSkJF7ij0p27eLfUIHjnByOzI0H55wDXH45k12qq6kcqquBmhq6sm6+mdMLjSjgcoUOxqiGH9wxkp64BZVV9dQwT/0rgCcBfC+G4hhRJJ4BXBGmlC5cCKxezYB3VhZw0EHA5Mm2LkWVOXOA558PPhe4pYVvvJWHjwiSJctopqo6e8zzAKxPpDwGmTiRf93u4FZCVxdw4IHxkckhJ4cz2o0YsnAh8PTTDNoEKupQ5fCXj33MNPEIIVliCLd73UerAJwO4CuJFshgevmxx9I3PxQdHQzgHn54/OQy4sTEiVzsa2uB9vb+tzlzgauqTDOPIJLCQlDVjyZaBiMwF1wArF0L7NjB4LJ/wklrK102111nWT0jlrPPZsHJo48yUOMUeWRmAueeC5x/fnyrE42YIprCFTxVVVW6fPnyRIsx4qmv56zwlSt9x0SA8eNZmDZvXsJEM+JFXx+wcSN3AVlZwAEHWDFaCiMib6vqoJJSU+1GSIqKgBtuAHbvZoGa07pi5kwmohijAJeLvUqMEY0pBCNsysp4MQxjZJIsQWXDMAwjwZhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAmEIwDMMwvJhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAmEIwDMMwvJhCMAzDMACYQjAMwzC8JJVCEJGviYiKSHGiZUl2VDnWcsUKYNUqoKkp0RIZhpHqJM2AHBEpB3AagNpEy5LsVFcDf/0rsGEDZxw7U1CPOgq4+GKgsDCR0hmGkaokjUIA8CsA3wDweKIFSWY2bgRuv51jbSsqONsY4FjLt94CNm0CvvUtUwqGYUROUriMROQ8ANtVdWXIk0cxfX3A3XcD+flASYlPGQAceTtlClBfDzzySOJkNAwjdYmbhSAiLwCYEOCmWwB8C8DpYT7O1QCuBoCKioqoyZcKrFvHBb+ycuhzJk0Cli0DPv5xYOzYuIlmGMYIIG4KQVVPDXRcRA4DMA3ASuGWdwqAd0TkSFXdFeBxFgFYBABVVVUaO4mTjw8+ANJDfGIuFy2HrVtNIRiGERkJjyGo6moApc51EakGUKWqexMmVJLS19ffTTQUqoDHE3t5DMMYWSRFDMEIj4oKoLc3+DmOMigri49MhmGMHBJuIQxEVSsTLUOyMncukJ0NdHYCOTmBz6mrAw491BSCYRiRYxZCCpGdDVxxBQvSOjsH397YCLjdrEUwDMOIlKSzEIzgHHss//75z8Du3Qwyq1IRlJUB119P15JhGEakmEJIQY49FqiqYsuKrVupFGbOBGbNYuWyYRjG/mAKIUXJygIWLODFMAwjGth+0jAMwwBgCsEwDMPwYgrBMAzDAACIaup2fxCROgA1foeKASRbhXMyygSYXJGSjHIlo0yAyRUpiZBrqqqWDDyY0gphICKyXFWrEi2HP8koE2ByRUoyypWMMgEmV6Qkk1zmMjIMwzAAmEIwDMMwvIw0hbAo0QIEIBllAkyuSElGuZJRJsDkipSkkWtExRAMwzCM/WekWQiGYRjGfmIKwTAMwwAwQhWCiHxNRFREihMtCwCIyK0iskpEVojIcyIyKdEyAYCI3CEi672yPSYihYmWCQBE5GMislZEPCKS0HQ8ETlTRN4XkY0iclMiZXEQkftEZI+IrEm0LP6ISLmILBGRdd7P7ytJIFO2iPxPRFZ6ZfpBomXyR0RcIvKuiCxOtCzACFQIIlIO4DQAtYmWxY87VHWOqs4DsBjAdxMsj8PzAGar6hwAHwC4OcHyOKwBcCGApYkUQkRcAH4P4CwAhwC4VEQOSaRMXh4AcGaihQiAG8BXVfVgAEcDuCYJ3q9uACer6lwA8wCcKSJHJ1akfnwFwLpEC+Ew4hQCgF8B+AaApImWq2qL39U8JIlsqvqcqrq9V98AMCWR8jio6jpVfT/RcgA4EsBGVd2sqj0A/gbg/ATLBFVdCqAh0XIMRFV3quo73v9bwYVucoJlUlVt817N8F6S4vcnIlMAfBjAvYmWxWFEKQQROQ/AdlVdmWhZBiIit4nIVgCXIXksBH8+A+DpRAuRZEwGsNXv+jYkeIFLFUSkEsB8AG8mWBTHLbMCwB4Az6tqwmXy8mtw8+pJsBz7SLl5CCLyAoAJAW66BcC3AJweX4lIMLlU9XFVvQXALSJyM4BrAXwvGeTynnMLaO4/FA+ZwpUrCZAAx5Jid5nMiEg+gH8BuH6AdZwQVLUPwDxvjOwxEZmtqgmNv4jIOQD2qOrbInJiImXxJ+UUgqqeGui4iBwGYBqAlSIC0P3xjogcqaq7EiVXAP4K4EnESSGEkktEPgngHACnaByLUiJ4vxLJNgDlftenANiRIFlSAhHJAJXBQ6r6aKLl8UdVm0TkJTD+kuiA/LEAzhORswFkAygQkb+o6uWJFGrEuIxUdbWqlqpqpapWgj/mw+OhDEIhIjP9rp4HYH2iZPFHRM4E8E0A56lqR6LlSULeAjBTRKaJSCaASwD8J8EyJS3CndgfAaxT1V8mWh4AEJESJ3tORHIAnIok+P2p6s2qOsW7Vl0C4MVEKwNgBCmEJOd2EVkjIqtAl1bC0/G8/A7AGADPe1Ni/5BogQBARC4QkW0AjgHwpIg8mwg5vAH3awE8CwZI/6GqaxMhiz8i8jCAZQBmicg2Ebkq0TJ5ORbAFQBO9n6fVnh3wIlkIoAl3t/eW2AMISlSPJMRa11hGIZhADALwTAMw/BiCsEwDMMAYArBMAzD8GIKwTAMwwBgCsEwDMPwYgrBMAzDAGAKwRghiEiliHR6e9Y4xwa1rhaRHG9+fM9w26N7H+tlb1dUiMiXva2fI2oBIiKFIvKl4cgSxnMMapktIpkislREUq5jgREbTCEYI4lN3hbjQ7auVtVO7znRaEHxGQCPenvlAMCXAJytqpdF+DiF3vtGhJBwf8MPYEDLbG8H1/8CuDjS5zZGJqYQjJTBO3zlNO//PxKRO4OcHo/W1ZcBcBoE/gHAdAD/EZEbRORy72CWFSJyj58V8W8Reds7rOVq7+PcDmCG99w7vNaO/07+ayLyfe//lV4r5C4A7wAoH+q5/AnSMvvf3tdhGKYQjJTie2DH2MvA1so3BDk3pq2rvb2NpqtqNQCo6hdAq+MkAM+Au+5jvdZIH3yL7mdU9QgAVQC+LCJFAG6C17pR1a+H8fSzADyoqvMB5AZ5rnBYA2BBBOcbIxjzHRopg6ou9TZQuxHAiY6rRkRuBZuq+RPr1tXFAJqGuO0UAEcAeMvbeTcH7MUPUAlc4P2/HMBMAJE2YKxR1TfCeK6QqGqfN54yxjvUxhjFmEIwUgZvi/OJAPY6i5eITEDg73HEratF5BoAn/NePRvABf7XVdX//p1g2+KADwXgT6rabySpt+/9qQCOUdUObyvmQI/hRn/rfeA57aGeK0KyAHQN4/7GCMFcRkZKICITwQE+5wNoF5EzvDfNB7AiwF0ibl2tqr/3um3mqeqOgdcHnNsIwCUigRb0/wK4SERKvbKPF5GpAMYCaPQqg4PAucMA0Ap2nXXYDaBURIpEJAucVzEUQz1XWHhdVnWq2hvufYyRiykEI+kRkVwAj4ID3NcBuBXA9703z0MAhRCn1tXPATguwHO/B+DbAJ7ztl1+HrRsngGQ7j12KzjHGqpaD+A1b4v0O7yL8w/B8ZOLEaR/f5Dn6keQltknAXhqf168MfKw9tdGSiMifwTdOhUAFqvq7DDvVw2gSlX3DuO55wO4UVWv2N/HSDQi8iiAm1X1/UTLYiQesxCMlEZVr1JVD5hdM9a/MC0QTmEagAwMc7i5qr4LDl8ZlOaZCnhdaf82ZWA4mIVgGIZhADALwTAMw/BiCsEwDMMAYArBMAzD8GIKwTAMwwBgCsEwDMPwYgrBMAzDAGAKwTAMw/BiCsEwDMMAAPw/yjotrlRUg/EAAAAASUVORK5CYII=",
1012 "text/plain": [
1013 "<Figure size 432x288 with 1 Axes>"
1014 ]
1015 },
1016 "metadata": {
1017 "needs_background": "light"
1018 },
1019 "output_type": "display_data"
1020 }
1021 ],
1022 "source": [
1023 "plot_dataset(train_x, train_labels)"
1024 ]
1025 },
1026 {
1027 "cell_type": "markdown",
1028 "metadata": {
1029 "id": "SjPlpf2-wHl8"
1030 },
1031 "source": [
1032 "## Training One-Layer Perceptron\n",
1033 "\n",
1034 "Let's use PyTorch gradient computing machinery to train one-layer perceptron.\n",
1035 "\n",
1036 "Our neural network will have 2 inputs and 1 output. The weight matrix $W$ will have size $2\\times1$, and bias vector $b$ -- $1$.\n",
1037 "\n",
1038 "To make our code more structured, let's group all parameters into a single class:"
1039 ]
1040 },
1041 {
1042 "cell_type": "code",
1043 "execution_count": null,
1044 "metadata": {
1045 "id": "J1KaixW-cMWJ"
1046 },
1047 "outputs": [],
1048 "source": [
1049 "class Network():\n",
1050 " def __init__(self):\n",
1051 " self.W = torch.randn(size=(2,1),requires_grad=True)\n",
1052 " self.b = torch.zeros(size=(1,),requires_grad=True)\n",
1053 "\n",
1054 " def forward(self,x):\n",
1055 " return torch.matmul(x,self.W)+self.b\n",
1056 "\n",
1057 " def zero_grad(self):\n",
1058 " self.W.data.zero_()\n",
1059 " self.b.data.zero_()\n",
1060 "\n",
1061 " def update(self,lr=0.1):\n",
1062 " self.W.data.sub_(lr*self.W.grad)\n",
1063 " self.b.data.sub_(lr*self.b)\n",
1064 "\n",
1065 "net = Network()"
1066 ]
1067 },
1068 {
1069 "cell_type": "markdown",
1070 "metadata": {
1071 "id": "rQ7W6TOacIAI"
1072 },
1073 "source": [
1074 "> Note that we use `W.data.zero_()` instead of `W.zero_()`. We need to do this, because we cannot directly modify a tensor that is being tracked using *Autograd* mechanism.\n",
1075 "\n",
1076 "Core model will be the same as in previous example, but loss function will be a logistic loss. To apply logistic loss, we need to get the value of **probability** as the output of our network, i.e. we need to bring the output $z$ to the range [0,1] using `sigmoid` activation function: $p=\\sigma(z)$.\n",
1077 "\n",
1078 "If we get the probability $p_i$ for the i-th input value corresponding to the actual class $y_i\\in\\{0,1\\}$, we compute the loss as $\\mathcal{L_i}=-(y_i\\log p_i + (1-y_i)log(1-p_i))$. \n",
1079 "\n",
1080 "In PyTorch, both those steps (applying sigmoid and then logistic loss) can be done using one call to `binary_cross_entropy_with_logits` function. Since we are training our network in minibatches, we need to average out the loss across all elements of a minibatch - and that is also done automatically by `binary_cross_entropy_with_logits` function: \n",
1081 "\n",
1082 "> The call to `binary_crossentropy_with_logits` is equivalent to a call to `sigmoid`, followed by a call to `binary_crossentropy`"
1083 ]
1084 },
1085 {
1086 "cell_type": "code",
1087 "execution_count": null,
1088 "metadata": {
1089 "id": "kdDxWeCqwHl8",
1090 "trusted": true
1091 },
1092 "outputs": [],
1093 "source": [
1094 "def train_on_batch(net, x, y):\n",
1095 " z = net.forward(x).flatten()\n",
1096 " loss = torch.nn.functional.binary_cross_entropy_with_logits(input=z,target=y)\n",
1097 " net.zero_grad()\n",
1098 " loss.backward()\n",
1099 " net.update()\n",
1100 " return loss"
1101 ]
1102 },
1103 {
1104 "cell_type": "markdown",
1105 "metadata": {
1106 "id": "zAAgw0h6KzUd"
1107 },
1108 "source": [
1109 "To loop through our data, we will use built-in PyTorch mechanism for managing datasets. It is based on two concepts:\n",
1110 "* **Dataset** is the main source of data, it can be either **Iterable** or **Map-style**\n",
1111 "* **Dataloader** is responsible for loading the data from a dataset and splitting it into minibatches.\n",
1112 "\n",
1113 "In our case, we will define a dataset based on a tensor, and split it into minibatches of 16 elements. Each minibatch contains two tensors, input data (size=16x2) and labels (a vector of length 16 of integer type - class number)."
1114 ]
1115 },
1116 {
1117 "cell_type": "code",
1118 "execution_count": null,
1119 "metadata": {
1120 "colab": {
1121 "base_uri": "https://localhost:8080/"
1122 },
1123 "id": "PfyqjVb2wHl8",
1124 "outputId": "f9f5af23-005e-42e0-928b-9890b6c4e0cf",
1125 "trusted": true
1126 },
1127 "outputs": [
1128 {
1129 "output_type": "execute_result",
1130 "data": {
1131 "text/plain": [
1132 "[tensor([[ 1.5442, 2.5290],\n",
1133 " [-1.6284, 0.0772],\n",
1134 " [-1.7141, 2.4770],\n",
1135 " [-1.4951, 0.7320],\n",
1136 " [-1.6899, 0.9243],\n",
1137 " [-0.9474, -0.7681],\n",
1138 " [ 3.8597, -2.2951],\n",
1139 " [-1.3944, 1.4300],\n",
1140 " [ 4.3627, 3.1333],\n",
1141 " [-1.0973, -1.7011],\n",
1142 " [-2.5532, -0.0777],\n",
1143 " [-1.2661, -0.3167],\n",
1144 " [ 0.3921, 1.8406],\n",
1145 " [ 2.2091, -1.6045],\n",
1146 " [ 1.8383, -1.4861],\n",
1147 " [ 0.7173, -0.9718]]),\n",
1148 " tensor([1., 0., 0., 0., 0., 0., 1., 0., 1., 0., 0., 0., 1., 1., 1., 1.])]"
1149 ]
1150 },
1151 "metadata": {},
1152 "execution_count": 14
1153 }
1154 ],
1155 "source": [
1156 "# Create a tf.data.Dataset object for easy batched iteration\n",
1157 "dataset = torch.utils.data.TensorDataset(torch.tensor(train_x),torch.tensor(train_labels,dtype=torch.float32))\n",
1158 "dataloader = torch.utils.data.DataLoader(dataset,batch_size=16)\n",
1159 "\n",
1160 "list(dataloader)[0]"
1161 ]
1162 },
1163 {
1164 "cell_type": "markdown",
1165 "metadata": {
1166 "id": "xrwgkbQjhkEp"
1167 },
1168 "source": [
1169 "Now we can loop through the whole dataset to train our network for 15 epochs:"
1170 ]
1171 },
1172 {
1173 "cell_type": "code",
1174 "execution_count": null,
1175 "metadata": {
1176 "colab": {
1177 "base_uri": "https://localhost:8080/"
1178 },
1179 "id": "QGchp9D6gVJa",
1180 "outputId": "b4c4751d-cb56-4104-d5b5-f1ae9d3d858d"
1181 },
1182 "outputs": [
1183 {
1184 "name": "stdout",
1185 "output_type": "stream",
1186 "text": [
1187 "Epoch 0: last batch loss = 0.6491\n",
1188 "Epoch 1: last batch loss = 0.6064\n",
1189 "Epoch 2: last batch loss = 0.5822\n",
1190 "Epoch 3: last batch loss = 0.5679\n",
1191 "Epoch 4: last batch loss = 0.5592\n",
1192 "Epoch 5: last batch loss = 0.5537\n",
1193 "Epoch 6: last batch loss = 0.5501\n",
1194 "Epoch 7: last batch loss = 0.5478\n",
1195 "Epoch 8: last batch loss = 0.5463\n",
1196 "Epoch 9: last batch loss = 0.5454\n",
1197 "Epoch 10: last batch loss = 0.5447\n",
1198 "Epoch 11: last batch loss = 0.5443\n",
1199 "Epoch 12: last batch loss = 0.5441\n",
1200 "Epoch 13: last batch loss = 0.5439\n",
1201 "Epoch 14: last batch loss = 0.5438\n"
1202 ]
1203 }
1204 ],
1205 "source": [
1206 "for epoch in range(15):\n",
1207 " for (x, y) in dataloader:\n",
1208 " loss = train_on_batch(net,x,y)\n",
1209 " print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
1210 ]
1211 },
1212 {
1213 "cell_type": "markdown",
1214 "metadata": {
1215 "id": "nnyEjYAWToPd"
1216 },
1217 "source": [
1218 "Obtained parameters:"
1219 ]
1220 },
1221 {
1222 "cell_type": "code",
1223 "execution_count": null,
1224 "metadata": {
1225 "colab": {
1226 "base_uri": "https://localhost:8080/"
1227 },
1228 "id": "5QaDiCQUkFOT",
1229 "outputId": "45b4a66b-1222-40f4-c758-d58f1c7daf8c"
1230 },
1231 "outputs": [
1232 {
1233 "name": "stdout",
1234 "output_type": "stream",
1235 "text": [
1236 "tensor([[ 0.1330],\n",
1237 " [-0.2810]], requires_grad=True) tensor([0.], requires_grad=True)\n"
1238 ]
1239 }
1240 ],
1241 "source": [
1242 "print(net.W,net.b)"
1243 ]
1244 },
1245 {
1246 "cell_type": "markdown",
1247 "metadata": {
1248 "id": "s4_Atvn5K4K9"
1249 },
1250 "source": [
1251 "To make sure our training worked, let's plot the line that separates two classes. Separation line is defined by the equation $W\\times x + b = 0.5$"
1252 ]
1253 },
1254 {
1255 "cell_type": "code",
1256 "execution_count": null,
1257 "metadata": {
1258 "colab": {
1259 "base_uri": "https://localhost:8080/",
1260 "height": 283
1261 },
1262 "id": "PgRTHttLwHl9",
1263 "outputId": "d9abf92f-cb70-4c56-ccd0-5e027239da58",
1264 "trusted": true
1265 },
1266 "outputs": [
1267 {
1268 "name": "stderr",
1269 "output_type": "stream",
1270 "text": [
1271 "C:\\Users\\dmitryso\\AppData\\Local\\Temp/ipykernel_89704/2721537645.py:17: UserWarning: Matplotlib is currently using module://matplotlib_inline.backend_inline, which is a non-GUI backend, so cannot show the figure.\n",
1272 " fig.show()\n"
1273 ]
1274 },
1275 {
1276 "data": {
1277 "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYQAAAEKCAYAAAASByJ7AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAABbH0lEQVR4nO2dd3jUVfaH3zvpPSEJJbTQERAIBFGwIYJYsCL2QnbXLe6u61Zdt7tVV1fX1d+uqwMiit21gIgFRFGUktBBioReQkivM3N/f5wZ0yaTSTItk/s+Tx7I5JuZkyn33HvK5yitNQaDwWAwWIJtgMFgMBhCA+MQDAaDwQAYh2AwGAwGJ8YhGAwGgwEwDsFgMBgMToxDMBgMBgMAkcE2oDNkZGTo7OzsYJthMBgMXYr169cXaa0zm9/epR1CdnY269atC7YZBoPB0KVQShW6u92EjAwGg8EAdPETgsFgMHQrampg716orYWUFMjOBovv9vXGIRgMBkOoU18Pb70F774r/wfQGnr2hGuvhdxcnzyMCRkZDAZDKGOzweOPwxtvQHo6DBggXwMHinN49FFYscInD2UcgsFgMIQyn34KGzZIeCg6uunPkpOhXz9YtAiKijr9UMYhGAwGQ6iiNSxdChkZoJT7a2Ji5LpPP+30wxmHYDAYDKFKaSkcOyYnAU+kpkJBQacfzjgEg8FgCFW0bv1k0BiLBez2Tj9cyDgEpVSsUuoLpdRGpdRWpdTvg22TwWAwBJWkJEhIgOpqz9eVlMCQIZ1+uJBxCEAtcIHWehwwHpillDozuCYZDAZDEImMhIsukrBRazgcUol03nmdfriQcQhaqHB+G+X8MvM9DQZD9+b886F3bzh8WEJIjbHZYN8+mDZNSlE7Scg4BAClVIRSqgA4Dryntf7czTV3KKXWKaXWnThxIuA2GgwGQ0BJTIRf/AIGD4bCQti/Hw4dEkdw+DBceincdJN3uYY2ULq5xwkBlFKpwOvAD7TWW1q7Ljc3VxtxO4PB0C3QGg4ehE2boKpKSlEnTBAJi3ailFqvtW7R3hyS0hVa6xKl1EpgFtCqQzAYDIZug1LQv798+YmQCRkppTKdJwOUUnHAhcCOoBplMBgM3YhQOiH0AZ5RSkUgjuolrfXbQbbJYDAYug0h4xC01puAnGDbYTAYDN2VkAkZGQwGgyG4GIdgMBgMBsA4BIPB0BVxOHyi3WNoSsjkEAwGQxBwOGD7dnjvPdi9W0TSTj8dLrhAGqF80OzkMxwO2LIFli0Tm7WWITEXXyz1+M1nBRjajXEIhlY5fly+LBaZwdGWAq+hi1FXB//9L3z+uXTDpqbKIrtuHXzyiXTAXnttaDgFux3mz4dVq+SN6JJpKC2FJ56A0aPhhz+EuLjg2tnFMQ7B0IKDB+Gll2Dz5qbzu6dOhWuu6VBjpCEUeeEF+OILGDSo6aLfp48swG+9BT16wIUXBs9GF0uXijNoPlQ+NVXekDt2wMKF8O1vB8vCsMDkEAxN2LcP7r8fdu1qaIrs31/WiNWr4S9/kU2ZoYtTUgIrV8pO290JICICsrJkjq9rqHuwqK0Vh9C3b1Nn4MLVwbtmDRh9s05hHILhaxwO+L//k4l8vXo1/exFRspnrqhITg+GLs7GjfKCR0S0fk1cHFRUSG7B19TWwpdfwtatciT1pKm2a5dcHxPT+jUWi9zH5s2+t7UbYUJGhq/58kuRXc/Obv2aPn3gs89g7lwTOurSlJZ6dgYulBKn4Cvq6mS3v3w51NTI/dvt8qa79lrJBTSnpsa7+46IgPJy39naDTEnBMPXfPll22uE6+eFhf63x+BHkpK8L9v0VaK2vh4efxxef112EwMGyLFz4EA4dQoeeADWrm35ewkJ3t2/3Q5pab6xtZtiTgiGr7HZvCsoUUqiDYYuzJgxDS+ku7g8SJgmOhqGDfPNY378MWzY0LKcVSlZyGNj4cknYcQIeTNWVoozGjKkYYxka87Jbm8omTV0GOMQDF/Tr598Dj2htXz2MjMDY5PBT2RmwuTJUnLqLrHscMgQljlzPMfuvcXhkFBRr16t7zri4iRJ9eMfy5ssIkL+HTxYQkmffCIVUc2PsVrL0Jjp080JoZMYh2D4mrFjZZNWUyP/uuPkSdkwZmUF1jaDH7jtNqk22rZNyktdSaGTJ6GsDM45R3oRfMHJk1Bc7HnM4/79Uj6algYzZojj0FqcxJdfyo5l/355c6any89PnZIcxxlnwPXX+8bWboxxCIaviY2VSXxPPikVfs2dQmmpOIsbbwyNXiVDJ4mLk934hg2wZIkkhpSCkSNh1iwJv7QWTmovDofnN015OeTnS2goLq7hWlc4KTERDhwQJ7Znj1QTORyyO5kxA047zbskucEjxiEYmnD22bIpe+45KQiJipLvbTbpAfr5z+XUbggToqPhzDPly26XBdhXTqAxqalSu1xX515iwlWl4HC4D/tERYmj2L3bNJ/5EeMQDE1QCs49FyZNkg1bYaFsvEaOhFGj5DNtCFP8ucOOiYFp06Tc1F3Y6OBBWfCrqloPK/XsKTmPO+4wR1Q/YT7eBrfExcGUKfJlMPiEiy6SBf3YMVncGy/q9fVyehg2rHXRLIulQeXU7Ez8gnlWDQaDZw4fFk0TV3nZsGEdO02kpcE994gYnevo6QojaS2JqzFjWv/9qipJJhtn4DfMM2swGNxz4gQsWCDyEo1JT5fk7tix7b/PXr3gd7+TXMDmzbLI9+4t1QzPPus5f3HiBNxyS/sf0+A1xiEYDIaWnDwJf/qTNIMNHNg0vFNeDg89JHLTEye2/76VklNG44a3ujppXDt4UMpLm3P0aEPvhMFvGOkKg8HQkldflU7hPn1aJnCTkiQH8PTT0s3sC6KjpQR20CAJTx05Ij0GR4/K9xkZUuKWmOibxzO4JWROCEqp/sBCoDfgAJ7UWj8aXKsMIHm83btlA3fihHwmp0yRMvWoqGBbZ/A5JSUiJd23b+vXJCRIw9jGjdIU5gtSUuDee+XNtnq1nFJSUuTNNnKk6TMIACHjEAAb8BOt9QalVBKwXin1ntZ6W7AN686Ul4se2Y4dUjkYHy/9QevWyabt7rs9rxuGLsiRI3IqaGsBjo4WaWpfOQSQHMLw4fJlCDghEzLSWh/RWm9w/r8c2A6YpSaI2Gzwz3/KZ37gQIkepKRIKDc7W7qW//pXOdkbDIauTyidEL5GKZUN5ACfB9mUbs22bSIhk53tvg8oI0OkZVauhKuuCrR1IUxJCXz6KXz0kejsuMZQ5uZ6L+UcTPr0aVAx9HRKqK31nRKqISQImROCC6VUIvAq8COtdZmbn9+hlFqnlFp3wozL8yvvvy/5Ak9Nob16wXvveS+tH/bs3Cm19i+/LE9KaqokZ+fPh1//Wmr6Q53UVAkDHTnS+jVVVdK9OG5cwMwy+J+QcghKqSjEGTyntX7N3TVa6ye11rla69xMo8Hsc44fhzffhH/9C959Vza4nhb7mBgJHVVXB87GkOX4cSnHjI+XGFtiomTdk5PlmFVbKz+vqgq2pW0zZ47Yf+RIy/GW5eXSbfyNb/hGGtsQMoRMyEgppYCnge1a64eDbU93w2aTWcnvvScngvh4KSI5eFASypMnS+SjOQ6HfJlqI+DDD8V7tia9kJkpHbobNoiKYCiTkQG//CVYrfIGcElRg7wR7r4bxo8PqokG3xMyDgGYCtwCbFZKFThv+6XWemnwTOo+vPiinAgGDmwIG48cKU2qSkkV4HnntVzrTp6U8tNuv1F0OGDFComheSI1VWJxoe4QQHoN7rlHBuU0lq4YPtyUgIYpIeMQtNafAEbCMAgcPy4ng8bOAKRhdMeOBjWBnTtFBdWFzSbRg1mzAmtvSFJX17q0c2NiY7teWVbfvqa2uJsQUjkEQ3D49FNxBM03fXFxUhjjyg8cOiT5Aq1lTSsslOqiUaMCb3PIERUlT2BbM0jr6qTTtw20Fkd94IAMLzMYAkHInBAMwePgQckZuKNPH5mPsGuXNJDu3SuVk4MGwe23Sxg57KTpKyth7Vr44gtJBPfrJ+Mkhwxp/Y+NiJAw0OrVnnfTxcVw882t/lhraRJ+6y1RbXCF7idMgNmz5RRnMPgL4xAMREd7riRKS5MqxPR00TMbMkRuCztHANJ88dhjcixKSZGF/sAB6SmYMEGGs7Q2cHr6dFi1Sn43Lq7lz0tLxfM2jrs1QmtYtEhmyGRmQv/+8hw7HLBliwwsuvtuzwrRBkNnMCEjAxMmtF0JWVUlxSU5OfJvWDqD/fvh4Ydl0c7OFq+XnAxZWbI137AB/vvflmWYLvr3h+98RwSfDh2SoS8gp4z9+8VR/PjHrVYhrVsnzmDQILnE9RxbLKIQnZYmMiIVFb7/0w0GMCcEAyJrn5wsG9iUlJY/11rCFzfeGOazSd5+W/5AdzF+pcQprF8vi3trsZszzhAH8uGHogZYXy8OZvZsib2lp7v9Na1lzn2PHq2PBEhMlKqutWtlGqXB4GvC+eNt8JLoaAkFPfCAnAR69WpYlKqqxBnk5EhEJGwpK5MtujstfhdKicP45BPPwfx+/eDWW2WYi80mv9PGkaqsTJL0rY0TdpGcLFMojUMw+APjEAwADB0Kv/kNvPGGbIJdycykJDkZTJ/edvPZ0aMNagf9+kkcvMtQViZ/tKeJXSAZdU+SDo1RyuuOvfp6eei2QnGRkb4bQWAwNMc4BMPX9OsHd94p2mynTsni06dP22GiQ4fgueckH2uxNITYx44VZ9JWr1ZIEBUl2VutPa/KNpv7hHEnSUqS/HV9vWcfUlEBp53m84c3GACTVDa4ITVVEpv9+7ftDA4cgPvvh6++kijKgAHyb//+0tT2xz/KySHk6dlTMrfl5Z6vq6z0yxjHmBjpBD92rPVrtJbTwXnn+fzhDQbAOARDJ9AannpKdra9ejXdWFsscrqor4dnngmejV6jFFx2mXSDORzurzl1Skp9OjJc3gtmzhTHUFzc8mdaS45h3Dgp+zUY/IFxCIYOs2+fLFIZGa1f06sXbN/eNVSfOessmDFDjjslJQ2xr/p66d6rq4O77mpbnqKDZGbCL34hp7J9+6R69dQpCckVFkp58He+03aaw2DoKCaHYOgwhYXyr6eQu1LytX+/VGOGNBaLVAaNHCk1oPv3y20Wi5SMzpoloSU/MmCATKHbvFmqiaqqJJJ19tkSigvL/g9DyGAcgqHDtBZZAdlcOxwNu9nWerlCDotFcgRnnCGnBJtNMr6tdSf7gehomDhRvgyGQGIcgqEFx45J89OxY9IMlZMjZamu3anr3969W/7uqVOid3TokDiE6GhZT1vTSgpZlJJ8gcHQjTAOwfA1dXWwcKH0XVkssimurYXFi0V1ISNDFvjsbLj4Ysmt9ughJfzJyRJ637hRksyJiXIf5eUyaMdqhZ//3KgoGwyhjElPGQAJ6fz3v6K2MGCAfGVmSsXLV19JTnXPHkkSFxfLiM1HH4UbbpDv9++HggI5DSQliTOoqZFTwrnninjeww+bpiqDIZRpt0NQSiUopcy4pDBj925Re87Oboj779kjX6mp4hxqaiSRnJYmfQo7dkhX849/LPLYtbXSOFVaKuF3pWDqVJHvycgQx7FxYxD/SIPB4JE2Q0ZKKQtwPXATMAmoBWKUUieApcCTWutdfrXS4HdWrpQQkSs/YLfDl182Vd1MTBTHMWyYOI3+/aUS5qKLpDZ+1KgGBYjUVHECjUskExPlBHLGGYH+6/xIW53NBkMXwpscwgrgfeBeYIvW2gGglOoBTAP+qpR6XWu9yH9mGvzNvn1NVZmLixuEOl1ERkqjbl2dOA/XYr9hg+QN+vSRr9aIjvbR9K+aGhkOsHu3LMbDh0vHVqAGOxcWyvzkNWvkWNS7t3jFM87ogtlzg6EBbxzChVrr+uY3aq2LgVeBV5VS3il4GUKWqChZZ124mwSptXw13vU3Fluz2z3PXq+p8cHErzVrYMECubPYWDHogw9EX+iOO2SEmz/58EPJvEdFSU9CZKTEyRYsgGXL4Gc/a1Xi2mAIddrMIWit65VSI5VS05VSiY1/ppSa5brGXwYaAkNubtPZ71FRLXsHamokFNRYfM1mk0Rzbq6oPniisrKTOjzr1sETT8jQhuxs2Zn36SNeJiEBHnlERov5i61bZeHPypJyqagoOaEkJYk9JSVig6fxcwZDCNOmQ1BK/RB4A/gBsEUpdUWjH//ZX4YZAstZZ8na5jol9OghIR7X0C+tpfR02LCGkLmrMW3cOClDra9vffLakSOScxg9uoMG2mzw7LPifdypjSYkiNHPPuu5Y64zvPmmOKPG0hVVVbBzp4w6W79ehiE/95w8WQZDF8ObKqNvARO11lcC5wO/Vkrd5fyZT7NpSimrUuq4UsqP2zyDO9LTIS9PNIdOnZI1NSNDqoy2bWvYeFdUSNPa6tUSRh8+XH43Oxu+/3353f37ZZ2sq5NN8759cs2PftSJiWs7dkgCIiGh9WuSk+WYsmdPBx/EA8XFkmXv0aPhtmPHJFy1Y4d8Hxsrp4N//1uGS7R1ZDIYQgxvPp4RWusKAK31PqXU+cArSqmB+NghAAuAfwELfXy/Bi+YOlU2wIsXw9Klsv5GRMjmPDFRdvn798s1cXGQmmxj2ydl/OPucr5zWw0Txg7hL3+J5JNPpLmtrEzC7NdfL6H9Tqk/HD/uvf7FiRNylPElVVXyZLiOR2Vlks+Ii2t6YkhIkMRyRQU89BD84Q+BS3Yb3FNXJzuaXbvkPTR4cGCLELoQ3jiEo0qp8VrrAgCtdYVS6jLACpzuS2O01quUUtm+vE9D+xg9WvoMRoyQzXBEhMT+339f1sLYWKirdTCl11cMs21HHbSx+ct0Hv/kMD+Z8n9kzLmaK684hyuv9PFeoT1HC0+Z7Y6SkCC7f1eZ6d698m9z5VObTRxCr14NrdthVWfbxdi0STouy8sbXqtly+Q1mjcPJk0Krn0hhjcho1uBJiNOtNY2rfWtwLl+scoDSqk7lFLrlFLrTpw4EeiHD3v275fN1PDh0ozmkqbo0UP6DE4b4eDcmC9I3rcJlRCHSktlQJadLbYR7KzsJx++JUt8b9igQfKvp1OCK3fgutaXpKWJCurJk+IY9u+XY1NzbDZJloAcpVas8L0tBu/Ytg3+8Q85CWRnSzFAVpb8PzERHntM8j6Gr/Gmyuig1trtzCut9Wrfm9SmPU9qrXO11rmZXWpob9dg7dqmkRG7XTa6rrUvqewgaTWHKVWp1NlkJ64UxEfWs+LoSNG8eOUV3w9A6NdPwkCe4vJHj4rAkr8kqi+/XLxjZWXL+luQXWhqakPZaWys+2k3Bv/jcEiBQUqKe8cdHy/vk4UL3ddYd1OMlpGhCcXFTWP99fWN+gu0Jv3kLuqj4kEp7Ha+/kqIquNgWbKUYkZEwKpVvjVMKfjmN+X+Dx1qWtpps8ksz6QkuPVW3z5uY047TTLvRUWSU6ivl4Wnpkay5/HxIp3tchR1dWKTIfDs3SsbhNTU1q9JTBSdFVdRgMGonRqakpbWVIDOYmloSItw1BNdV05NTAr11ZJkdpWl1mBhQM866uogukcPmfBy/fW+Na5XL/j1r+G110Qzw2UcwJQpcPXV/pesPv980QL/9a9F/CkmRhaWUaOkJ6Jxk0ZJCcyZ4197DO5pTzj52DEYM8Z/tnQhvHYISimF6BkN1lr/QSk1AOittf7CV8YopRYjpa0ZSqmDwG+11k/76v4NbTNpkqQAXLnT6GiJgJSXQ1IMgKKsTH0tXxETI9cVV8WSVrmLjz6Csyco4iL91AuQmQnf/jZcd53sAEHiwo11N/xNv35SVvr730tznLvyqeJiCVdMmBA4uwwNeDtnVGv/FCF0UdoTMnoCOAu4wfl9OfC4L43RWt+gte6jtY7SWvczziDwDBwokZFDhxpuGzZMTg31RFFhi8VWVUdSUkOjbo09iugIO5P6HKKmBrZ/VoL2ddlnc1JTJck7cmRgnYGLQYPgW9+S3eWhQw1x6JoaSTg7HCIDa7SNgkN2dsPYvtZwnS79UYTQRWmPQ5istb4TqAHQWp8C/DNt3BA0lILvflc2wV99JSHWnj2ldPvwEUV+7UjSoiuJiQGHVhTXJVBaH8+VWWtJjKwlKcFBVUkt+wdPC/af4n+mTpVTwtSpclopLJSE85VXwv33+0C4ydBhevWSXoNjx1q/5vhxkekdMCBwdoU47ckh1DvnIGgApVQm4Ke4gCGYJCfDPfdIRd6yZZKvTU+HCy6A1SuzOFF2kuiKCuqiEhmaeJQp6V/SJ64Ei8NGSul+1mVdwNET2XSL5XDAALj9drjtNjklREYaOexQ4ZZb4E9/khNc794NoSGHQxx4dLSc8szr9TXtcQj/BF4Heiql/gTMAX7lF6sMQSc2Vja+U6c2nKx37ACbLYreSSMYuelFsovWkRRRha6LwFJrx2GJZMfwy1nf4yrOqOwmH7KqqobpQMnJknDusD6HwadkZMCvfiVl0J9/3lSEa+JEuPZaOUkYvsard64zobwKWA9MRyQrrtRab/ejbYYQwfU5SkoS5xCVmsDe8/I4VnEpmSe2ElVXRU1cGsd6jaUuJoma/fJZDGvq6uD116WF22aTJ0lrcQrXXAPnnGN2nqFAenpDEYIrMdanT1NNKsPXeOUQtNZaKfU/rfVEwBTtdlP69pXcQmmp5HQrE3tRmdh0h+VwyFdYKwLU18tQ6U2bGmSwXVRVSbd2WRlcdlnwbDQ0JTXVc0+CAWhfUnmNUiqcP+aGNlBKyuqLi5v2KrjQWgpspk4N85P4mjVQUCBJ48bOAKSqaMAAePVVadQwGLoQ7Ql2TgO+rZQqBCqRsJHWWo/1i2WGkGTcOGnWXejUo+3RQ6T/v/xSGnhdLQHHjoWpU9BapGAzMloPCUVFSR38xx/D3Llt36fdLgmaFSsk2RkXJ412kya5l10wGPyE0l5KCjvlrlugtS70qUXtIDc3V69bty5YD9+tOX5c1rvFi2UtS04WQby0NImWOBwSSr/00jALpZeXww9/KKcAT39YRYVk5v/4x7bv77HHZMhOQoJ81ddLl3NcnAyRGDHCl3+BwYBSar3WOrf57V6fEIK58BtCj549xQnExUnZfePCmpQUWdNeeEE2uOefHywr/YCrhbstL+dKMnvCbhdnsGePNFI1vs/UVPGsf/+79DpkZXXWcoOhTdojXfEbd7drrf/gO3MMoUBxsWiD2WxSpDFkSEslgNpakRTq1899lWVUlORbX3lFcgrNQ+1dlsRE8XiVlZ6nt5WUwNlne76vnTsl1jZwoHsHk5wsJ4h33xXtfoPBz7Qnh1DZ6P+xwGWAKTsNI8rKZBzwF051KtcmNzMTbrxRpp652LZNVBo8DZ2Ki5PQ0vbtokodFlgsMkD6uedalzyw2+WIdN55nu/ro4/kSfJ02ujVS+aVXn+9+1nS3nLkiGibnzghTm3iRPH0wY7nlZZKj8D27fJmGzkSzjzTVAQFifaEjB5q/L1S6u/Amz63yBAUysvhr3+VBbxfv6Z6X2VlMmfkzjsbhn+Vlno30VJruTasOOccWaQPHpRjUONF1WYTCYuZM9uWrjh2rG2to8hIeRIrKzvmEGpqYMECqYyyWJwj7+rgnXdEj+TOOxvmNwQSrWHlSli0SBJOruT5xo3w8stwww0wfXrwHVY3ozMtlfHAYF8ZYgguS5bIJtLdGpbsHHPw1FOiEhwfL13/Wosjsdnk5wkJ7j+/zadMdnni4uCnP4X58yE/v0Ex026XBfyqq+CKK9pezOLj2x6g4xJo68iT6HDAf/4jNjYPS2ktjVoPPCBS3oGuZvr0U3n++vZtesxMTxeH9cwzcvs55wTWrm5Oe3IIm3HqGAERQCZwvz+MMgSW6mr48ENp4GwNV/hn/XoJjdfUSCk+NIwlcAmQ9u4tt9vt8rOwLJJJSpJqo2PHYOtWaUjr0UNiY94urlOnipdt3jVbVydPsFLy7/DhHVN03bkTNmxombAG+b5PH9i3T8rFLr64/fffUWw2eOkleaO4izlGR0sS/aWXJHwUNgmo0Kc9J4TGbZc24JjW2syeCwOOHZPPaFub0Ph4yR2UlcGLL8pm7tQpybFqLWvXp5/Kmjh0qGxAp0wJ83Bwr14db7iYMEGcR0mJPEkVFaKLdOBAw1SiujopPXUJ57WHDz6QF83TSaVnT0laX3SR9zMEOsuOHfIm8hRSi4uTN2ZYJaBCn/a8A76ntS50fh3SWtuUUn/zm2WGgOGqpPSG48clxNu/v2zeUlLEKdhsEp5OSZGTw+bNsjG98UZ/Wt7FiYuDu++WI5qrMe3AAYm9RUXJCzN8uOzgn3iiYTydtxQWtn2yiI+Xxbm6uuN/R3s5dcq7BJTrWkPAaI9DmOHmtgCeMw3+omdPcQieZo27ksNHj8paFRUlJ4qpUyWvYLPJzysq5PpBg+DnPzfzYdpk8GCZvlZeLkcsV2ImOVmOV+PGyTXr1sF777XvviMjPQ+IgUbzUQM4Naw9ISCjHBtQ2ny2lVLfBb4HDFZKbWr0oyTgU38ZZggcCQmSu1u1Snb+jXE44PBhObmfONGQK6iqkhN/dLRMVBsypEHfSClZ09xNljS4obhYvPKECRIiiohoGb/r00cqg2bM8H5Bdc1D9dQvUVwsL6Cn+mFfM3SovEkcjtbDVA6HXOPvyXuGJnhzQngemI2UmM5u9DVRa32TH20zBJDZsyXcc+RIw2ne4ZAk8mefybpxxhkN0YytW8WBuCINFotEQOLi5Od1dcH7W7ocGzaIA4iIkCfQXTInLk5KTxvPNm2Ls8+WF9OdEiHIC1xSApdcEtjyzowMyM2VnUZrHD4MOTniKA0Bo02HoLUu1Vrv01rfAJQBvYCBwBil1Ln+NtDge7SWUPXmzRK6rqmRQpd775W4f2GhFJ98+qn8PC5O8gVDhjTMREhNFWewbl3LcHB5uVFaaBc1Nd6FRiyW9uURevaUSW4HD8rC3/iFqqyUGakXXihhqUBzyy1i3759TR1Wba28ATMy4NZbA29XN6c9ZaffBO4C+gEFwJnAZ8AFfrHM4Be2bpVqvsLChtN6VJREImbPltGZhw5JNdFjj8G55zZtVBs2TE4NMTFSIHPyZMN8BBenTkljrcFL+vaVbl1PaC11vGlp7bvv886T33n1VdEmd9UIp6SIHMb55wen+Ss5GX75S6lweu+9BkcXFSUnllmzZPdhCCjtydjcBUwC1mitpymlRgK/96UxSqlZwKNIn8NTWuu/+vL+uxrl5bKJc2kKtSWw2RZr18pcl9TUpn1KdXXw1lvyWHfdJQ6gqkokK5rPH8/Kgt27pTAlKUnu4+hRuU+t5aQ/aJCc9g1eMnmyLNh2e+vJ3RMnYPRo2TmfPClxvH375Ppx4+QJb62TeexYOP10eXFcyZ3+/QObSHZHYqJI4l52mWing/x9gcxnGJrQHodQo7WuUUqhlIrRWu9QSvms5UgpFQE8jlQzHQTWKqXe1Fpv89VjdBUqK6W085NPGnJrdrt8hm+4AUaNav99lpfLIK/evVuuG9HREiravFnUBGbOlJO7O+cTGSnFL198IXmFmhr599Ah2eSNGCFqCI0/01rLiWT3brmmd29Z28Kug7mjZGZK6Obdd+WFaJ5oraiQJ/qqq2Rs51tvye0JCfIG+fxzKef67ncl9rdrlzzRGRkNT7RSchIJRWJiQte2bkZ7HMJBpVQq8D/gPaXUKcBDVqjdnAHs1lrvBVBKvQBcAXQrh1BZKWoCBw7IbtwVWtZawsAPPCB9So2F5rxh7VpZI1rbRColC/XSpXDBBXKidzjc9yjExkpV0qlT0nMwfLg4icmTpUKy8fVHj8KTT4p6Ksha53DI+nXjjVK2auRqkJm/dru0jEdEyO7ZbhdnEB8PP/mJxPtee02Od41zDpmZcoKYN0+OdElJDaGh+HiJ35kZzwYvaI+43VXO//5OKbUCSAGW+dCWvsCBRt8fBCb78P67BEuXym46O7vp7UpJKDg6Gv79bxGba4/WWUFB2yHZ+HiJRhQVybrSu7eEhlJSWl6rlNw+dCj84Q/uZ5afOAF//rOEvJpL6VRXi8yOzRZm8xI6SmSkJFFnzBDhvH375MWeOFHKUevr4eGH5YVpnoCurha9oupq8dKnn97wZFdXy9Gwvl7E4gwGD3jdmKaEm5VSv9Faf4Qklsf70BZ325cW7YxKqTuUUuuUUutOnDjhw4cPPjU1ojbgqUInIUGuy89v3327dIXawlUe7pqffPKk+6pFh0Mc1/nnu3cGINGNqqqGxrfGxMVJruK55+RUZHDSp4888T/9qWglTZ0qT9b69fKku+tB2LVLFv6MDHEIru5AkN/t3x+ef168u8HggfZ0Kj8BnAXc4Py+HIn5+4qDQOO2qH64CUlprZ/UWudqrXMzMzN9+PDB5+hR2ch5oym0ZUv77nvIEMkjeKK+XpyGq5Bl4kSJQhw7JiGs8nJZvI8ckYKVc86RnIY7SktFcdmTYF5MjDymmYLqBYcPu39j1NfLaSIxsWGSW3MZiujohlyDweCB9jiEyVrrO4EaAK31KcCXacG1wDCl1CClVDRwPd1s3kJbKgMuXEnm9jBlivyOp987cgSmTWsaipo2Df72NykEcTWlTZokisnf/GbrTbPHj4udbRWyxMU15BcMHoiJcf/iVVa2lJ5wdxRMSJDpbAaDB9qTVK53VgJpAKVUJuDlEtY2TrG87wPvImWnVq31Vl/df1fAdeBpS9iyqkp2/O2hd28p7V6ypGVOUmuJ9ycni+ilO7uuukq+vMU1bU1r2cQqJY/ZPHTUHmG9bs2YMfD2256vccUF3SV9zBNt8IL2OIR/Aq8DPZVSfwLmAL/ypTFa66XAUl/eZ1ciKUl28p99JvF1d7jCOpM7kG6fO1eiB0uWNISjXaeGgQPhe99rPR/QXhITpRR182ZxcFrLfQ8bJs7JtTbV1soMBUMbDB8u8beiIskVuEhMlDeEzSa5g6FD3R/bqqo6Vq9s6FZ4I273rNb6FiAD+DkwHUkAX6m1NjOVfczll0tF0PHjsjNvvKmrrRUVghtvdL8JbAuLBa6+WopNNmyQnEVsrBSl+HK8blERPPSQrEE1NdJUp7WsV599JqWp48bJz+Pi2l9C2y2xWOD734e//EXeBL17y5ErMlJ2D1u3ild3511d0hi5uYG329ClULoNXXKl1DZE5vpN4HyaVQNprduYAeg/cnNz9bowzEgeOSKlpS55CdcGMDoarr1WephC9fTvcEgZ6tGjkpz++GMJcycnN4SRioulgS0xsWM9Fd2a48elMe3TTxue0IgIqS5KTJSKosY5hPJyiQd+5zty/DQYAKXUeq11ix2CNw7hh8B3kfnJjaUWFaC11kGbqxyuDgHkc753r0xBrK2VaMG4cR2bsx5Idu2CP/2poY+ipkbCRocONTix+nqplHrqKTMMq8OUl0tNsMUib47qaqnh/eKLptelp0sp2MSJwbEzhLE77JTXlZMamxpsUwJOhx1Cozv4P631d31uWScIZ4fQVXnhBemlaK5E4OqZcjXPlpXB737neYqioQMUF8OePXKk7NFDcgrB1iwKMfae2suCggUsKFjABYMuYMGVC4JtUsBpzSF4k0NQWmjVGbiu6ayRhq5Pebn7nKZrVoKLiorWZfoNrVBXJ6WjlZXyZA4f3nIKUY8evqsMCCOq6qt4bftrWPOtrNi3AoVi5pCZXDnyymCbFlJ4U2W0Qin1KvCG1nq/60Znr8DZwG3ACmCBXyw0dCkyMyVM5AmtJddg1I29xOGA5cvhzTflqOXKHURHw8UXS5OIGTXZAq01aw+vxZpvZfGWxZTVljE4bTD3T7uf28bdRv+U/m3fSTfDm3fRLCAPWKyUGgSUALFIr8By4B9a6wJ/GWjoWpxxBvzvf57L3ktKJMfQu3cADeuqaA2LF8OyZRKHazxBrK5OxO6OH5cuQW+0SboBxyuPs2jTIqz5Vrae2EpcZBzXjr6WvPF5nDPwHCzKPE+t0aZD0FrXILIVTyilopDy02qtdYmfbTN0QbKypEfi889bCtqBhIlOnZL1K1QrpUKK3bvldJCd3TIX4NIt/+QTedKDMfksRLA5bCzbvQxrvpW3vnwLm8PGmf3O5MnLnmTu6LmkxHagTrsb0q5zpta6HjjiJ1sMYcK8ebJ53bBBEsiJidKbcOSIOIHbbpPGW4MXfPCB5AlaSwxbLFLTu2xZt3QIO4t2Mr9gPs9sfIajFUfpmdCTH03+EfNy5jEq0zTitRcTeDT4nNhY+MEPJP/57LOywa2tlQbbnj1l7dq6Fb71rZYT2QzN2LJFSkc9kZ4uw68djm4RNiqvLeflbS9jzbey+sBqIlQElw6/lLzxeVwy7BKiIloR2DK0iXEIBr/gmgd/6JCooiYnN/xMaymh//Of4Ve/al2mw0BoahCdPAmbNkntcHKyNJO05bQ6idaa1QdWY8238tLWl6isr2RE+ggeuPABbhl3C70TTULKF3TIISilemutj/raGEP4YLPB00/LOtG8mkgpOS0cOya9VL/4RXBs7BIMHSrdfo2Tyc1xZen9fTqorYVFi2SAj8MhlU02mzzu1Klw880+n4d8uPwwCzcuxJpvZVfxLhKjE7lhzA3k5eRxZr8zUaHmLLs4HT0hLAUm+NIQQ3ixfbvMRPDUeNazp0Q6Dh9uGApUVCRKCxERcnKIjw+MvSHLzJkyDam5sJULrSVLf9NN/rXDZoPHH5eTwYABTZ2PwyEaJaWlMtSnkyWwdfY63v7ybaz5Vt7Z/Q4O7eDcgedy3zn3MWfUHBKiEzr5xxhao6OvnHHLBo8UFrYd6XDNczlyRBRXX35ZZC5c44AjI2Uew+WXi5x/t+S00+Css0QVcODApsllh0MmF51+OuTk+NeOzZtFdXHQoJYvrMUitm3cKNd10JbNxzYzv2A+z256lqKqIrKSsrhn6j3cPv52hqUP6/zfYGiTjjqE//rUCkPY0Z6T/KFDMl85IqKpNlt9vSSkd+yAn/+8mzoFi0VqdJOT4cMPG2YeuOacnn22nA5am1TkK5YtE4nd1l5YpRqqndrhEEpqSli8eTHWAivrDq8jyhLFFSOvIG98HjOHzCTCYmQ3AklHHcJrPrUixCkvF82w996T03lCgswSnjrV77k0v1JUJIttdTWkpkopqK/E8wYNkl2+JxwOWd+WLpXQUGpq059HRcnGs7BQmnRbG9cZ9kRFyaJ/2WVSdVRaKrW8Y8YETqZizx7Pw75B5G337GnzrhzawYqvVmAtsPLa9teosdVwes/TeeSiR7hp7E1kxGe0eR8G/2ByCG1w8CA8+KAUVKSnS9y7thbeeEMGzdx1V9ebO1JZKeWga9Y0vT06WsIzl1zS+fzkiBGyVpWWtj674dgxCY2fPOm5azkrC1asgCuu6OY5hZQU2YUEA5dchidcp5ZWKCwpZEHBAuYXzKewtJDU2FTyxueRl5PHhD4TWiSIbTZ5b7iGK7U1a9zQeUwOwQOVlfD3v8v7vHFyND5evsrL4ZFH4P77oVevoJnZLmpqZHhNYWHL3GBdHbz4ogjPXXdd56odIyLg29+Wecx2u2weXfentTiD6GiZoFZW5vm+oqJkcThwQByNIQicfrpUCnh6o588Kdc1osZWw+vbX8daYOWDvR+g0Vw4+EL+Mv0vXDnySuKiWh5Jq6ulH+/dd2WIEkjx0oUXwowZRgPLn5gcggfWrm2o6HNHUpLsgFesgOuvD6RlHWf1alFDGOxmioVLCeGdd2Qj2r+T2l/Dh8O998KCBU2TzFpLrvS22+D99707jSjlfsZ8WGGzyWoYFdVSxTTYzJgB69a13vzmcMgOasYMtNZsOLIBa76V57c8T0lNCQNTBvLb837LbeNvIzs1u9WHqaqSTdiePXJqdIVka2slbPjFF3DPPS3Diwbf0CGHoLV+wteGhCIffNB2iLZnT3EIc+c2/Zy4Btxs2CA77sxMmDQpuCcJh0PCXJ5siIgQx/DRR1JW3lmGDpUT1L59MkXNYhFH4wpH9+vXtgy2Sx01I1xDyydPwsqV4h1ra+UPHj1alExHjQqNxrSRI2WL/t57IrLX2GHV1MChQxRdcCbPlb6L9T/Xs+nYJmIiYrhm1DXkjc9j2qBpXonKvfACfPWV5KAaExMjm5VDh8BqhR//2Ld/nkEwncoecOXuPBEdLaGWurqGz8jJk/Cvf8kbOzJSNny1tfDqq7LzvuUWn/fveEVFhZx42pKLSE2VZLOvUEo+4M0/5CBjfhctkuevtRjxiROyPnrqzeqyHDgAf/sbtspatqoxvHvgNL46lUrkukpyXvuUabcdIvtbM1CWIDsFpWSHkJkJb78tCquAHQfLU4qwTirljYMvUr+/ntysXJ645AmuH3M9aXFpXj9EWZmcYD11rmdlSSvEkSMyKM7gW4xD8EByspzgPSWz6utlwXddU14ucfOyspZqn67+ndpa+O53Q1d2JpCjjhITYc4c6Vju37/lc11aKs/x3LmBsylg1NbCP/5BjSOaxw9dxqZjvUmKqaVHXA06LpI1FeNY9UAtV1bt44ofDQr+QcFikVPL9OnsLviA+V++zDOHl3Go+hjpNencOelO5uXMY2yvjs1F3bVLPiOeBry5cts7dxqH4A+8mZjmTV2bozNy2Eqpa4HfAacBZ2itQ2Iu5rRpsnv1lMQ6fhzOO69hcV+1Sm5zl3ewWOT2L76QkOzw4f6wunUSEyXsUl7u+W8qKZHoQKC46CL595VXJIweGysLQ12dJKN/8YswFcHbtAmKi3mm6Go2H+9FdmpJk0U/K6UKW2Qtrz5TTnqu5pxzgusRKusqeWXbK1gLrKwqXIVFWZg1dBaPjs9j9ojZREd0rgyovt676JjF0vYQJkPH8OaEcNj55emligA685HdAlwN/KcT9+FzXMNeTp2Shak5VVWyW7ngAvnebpfKCE8xeqWk1v/DDwPvECwWKSl9+mlxDu4+fDab/B3nnhs4u5SCWbMknLZ+vSSgo6IkTDR6dBgPA1u9mmOWPnx2sD8DUkrdvh6R8dH0KjrEGy8OZ8qU2ICPR9Zas+bgGqz5Vl7Y+gIVdRUM6zGMv0z/C7eMvYW+yX3bvhMvSUvz7nSqdRjnk4KMNx+17Vprj62HSqn8zhihtd7uvJ/O3I3PSUqS5NXf/w7790v4NDZWdjLHjslCduedDQnSqiqJ07eViE5OliRrMJgyRYbX7NghucHGi211tegKXXtt2z1I/iApSRr+ug2VleSfysaioNUUgVIkRtex/6SDwkL31WH+4GjFUZ7d+CzWAis7inaQEJXA3NFzycvJY2r/qX75rA4dKk6hoqL13F1treTfzDwN/+CNQzjLR9f4BKXUHcAdAAMCEEcYNAj++EdJdi1fLo4gLk40x847r2lDVUSE7F7aUix2OILXZBMdLc10L70klUQOh9yutXwI582TUJkhAPTsSXGZIsrioZ7W9QJFRVFR0Y77rquTkNSaNVIO2quXyFwMGdLqm7PeXs/SXUuxFlhZ8uUS7NrO1P5Tefryp7l21LUkxfi3ASAiQvpf/vUvOSE2L7yw2aRR9OabQ68qN1zwdoSmW5RS87TW8z1d0+ja9wF3/aj3aa3faOv3G9nzJPAkQG5ubkDSn2lpohpw2WWeZ5DExYkDOXnSfYjJRXGxdAQHi9hYuPVWuOoqGWJTWyunlhEj/C+JY2jEOeeQvHgJ9Q4P1QWVlZCVhY6I8l5WZP9+6Zg8dUo6KKOipLB/5UrZWn/3u02Eobad2Mb8/Pks3LSQ45XH6Z3Ym59O+Snzxs9jREZgOwEnT5aT6rPPymctOVn8V1mZbFquvVY2Ywb/0Nno7O+B+d5cqLUOYJrSf3iqDFJKYvT//KeoDLi71lVzHywFgsYkJcHEicG2ohszfDg5k5bzymvV6CTdsrS0rg4cDqr6DSc51n3ZbguKiuCBBxoUSF2kpsqKum0b/OtflP3gDl7cLgniNQfXEGmJZPbw2eTl5DFr6CwiLcFL3Jx/vkwDXbNGpJscjgbtsMzMoJnVLfCmymhTaz8CuohgQ+CYMEFCSStXSlmcS3tHaymhLC4W8Urzxu4+nDghlVtRUVJj/3XexmKh76/mMX7zZ2z+MoZ+qRWomGhZAaurISIC+6QzOVKVwu1zvUyuf/CB/K6bNnOtYFV/O9YTT/Lyw7+j2l7DqMxRPDTzIW4eezM9E0Kn0SMtTSpcL7442JZ0L7x5i/UCLgJONbtdAZ/6wgil1FXAY0AmsEQpVaC1vsgX9x1oLBa4/XbZnL39tmzYlJLP+IABkJcnEwcN4c/u3dKMuGNHw4yHpCRZ5C680LnAJyXxzecv4B+/KmL358X0qC0iOd6OHjSEorj+VNTEcNFFXuZ16uulbb5ZmdtByniGAuZTwB7LKZITork16gzy5j3EpKxJIVfMYQge3jiEt4FErXVB8x8opVb6wgit9evA6764r1AgIkI+8OefL+FcV4w+Kys0VAj8SVWV5FCUks7i7qpQuXGjhPETEmQj4Hrdq6rg+eclpP+d78h7JTE1kp8/1Jt163rzzjtQeFAcyOljJF7utXpFZeXXLd+12HiTnVgp4F12oxVM09n8Tp/P1VUDiLclQN8z/PkUGLog3iSVv+HhZzf61pzwIjIycGWCwaa4WHSSVq1qKIyJiZGms5kzfTdnoStQUQH/939SK998qE98vOQC1qyR/O5558ntMTESI586tWEGTrs3D1FRFEQWYWUrz7GZYlVNf53MrziX2/V4BuOsdLCVQrIp0zG0JFxbfgwB5Phx+MtfJEfSp09DpVJNDbz2mkxe/NnPus8sg7UfVVHzVQm9bXukVjI5WVrUe/QApb4+PS1ZAuec07L4oL3NZ8XVxTy/+Xms+Vby++YTrS1cxWnk6RymM4gImj1ASYlUPxgMzfAmqbxBa+1xGI431xjCE61l/GV1dUt5iVhnZUxhocxLvu224NgYULZsYf0fd5Bckgwpzhrlw4dFxK5XL1Hzi4oiKUnCicXFHeu6tTvsfPDVB1jzrby+43Xq7HXk9M7hsbH3cOMbe+nRf7h7z1JRIXG8yZO9fzCbTby9UlKtFKoiXIZO480J4TQPlUYgyeVWZmIZwp3CQomHN65wbE5Wloj6XXNN2+qxXZp9++Dhh6mLnENEShLEOmuMo6MbpgJt2CCaKM6Tgs3WvofYe2ovCwoWsKBgAQfKDpAWm8a3J36beePnkdMnRx6n/mV46y0ZJuCag+xwyFGurg7uvltOLW1RUSEaK8uXN0yqSUuDM88U7x8ZKS+uUZkLG7xxCCO9uCbcR5cYWmHHDllvPMW7IyNlPdqzR+rLw5a33oLoaLJ7VvHVV71IcTkEkCcoJUV0m0tLqU9IJSLCu0EvVfVVvLb9Naz5VlbsW4FCMXPITP4+8+9cPuJyYiMb5QOUku6tQYOkzO3AgQaJ0IkTpbvSk/d2UVIisr1Hjkg7fkaGOIi1a0XgKy1Nst0REdLRePPNnnWrDV0Cb5LKhY2/V0r9ARGzKwAKtNa7/GOaoStQW+t9zLu9u+EuRWkp5OdDv36cHXeA5XuG4tDNNIqUknDL/v0cTUtl2rTWJRi01qw9vBZrvpXFWxZTVlvG4LTB3D/tfm4bdxv9UzyMs1NKpjHl5krJV12dHM28ORW4ePppqZl2yfaWl8sxz+EQEayyMqlqGjNGjol//CPcd1/nx+wZgkq7k8pa698opXoBOcA1SqkhWutv+d40Q1egZ8+2R1u69J3aEv3r0pSVfb3g908u5ZwBhXxUOJDs1FIsqpHCSlQURcdsxPcVhdfmHK88zqJNi7DmW9l6YitxkXHMGTWHvJw8zh14rldTx75GqY4lKA4dkhbhxkmhjRvFGbhifklJMgFqxAjJjRQVwVNPwe9+F/611WGM1w5BKfUIcLcWjgHLnF+Gbsy4cVJV5GniWVmZhJlbm00dFkQ7O4y1RinFreM2EmWxs2LfIJTSxEXasDks1FbG0GsA/PCehrXa5rCxbPcyrPlW3vryLWwOG5P7TuY/l/2H60ZfR0psgFN027bJv66FvaxMFvyURnZERMjfW1zcMPy4sFDyKO40NoqK4NNPxdGAjOScOjW4M2UNLWjPCaECeFMpdb3WulIpNRP4rdY6BFR5DMEiPh6uvlomng0Y0FIcr7pa1oyf/jTMN449e4rXKy+H5GSiIhzcOn4Ts4bt4fODfTlSkUhcpI0JjnWM/NUcIvrCzqKdzC+YzzMbn+FoxVEy4zO5a/JdzBs/j9E9Rwfvb6mpaVpJVFYm/zZ/AZVqOB66frZ/f1OHoLUkpV98Ub53OZU9eyTncsUV8hXWb46ug9cOQWv9K6XUjcBKpVQtUAnc4zfLDF2Giy4S1YTXXpPPdUKCrAOVleIg7rwTTj892Fb6GaVg9mx4/HEJqzgX1J4Jlcwe8aVcU1xMeZTmGdZhtf6Q1QdWE6EiuHT4peSNz+OSYZcQFRECcrPp6U3jgK1NrdG6ZRLE1ZXo4pNPZOxg8/moKSmSVHr1VXnDzJjhG9sNnaI9IaPpwLcQR9AH+IbWeqe/DDN0HVxr4ZQp8NlnsHevrIdjxkhes3mp6cmTct3ateJIBg0SmY8hQ7p4ifuZZ4qA0fLlkjBJTQWl0PV1rD61EWvyXl5K2k/l0ipGpI/ggQsf4JZxt9A70Z0qfBAZO1ZKw1wDw10vYONBH3V1cjxsnhhqPCDEZpPBG336uI8nRkZKZdKrr8qIvuYDEAwBpz0ho/uAX2utP1FKnQ68qJT6sdb6Qz/Z5hccjob8X1JSF1+AQoz0dKlq9MSnn0oBi9ZSuWixwLp1spHMzZXTRmGhrEW9eolTCfY6UVwsdn/2mURTeveWDe3o0c1CZEpJ+eVpp8GSJRw+sI2FiXuwJu1mV69SEqMSuGHMjeTl5HFmvzNDV1QuMVE8/CuvSOInNVUqlGpqRIPEbpcSVGc/BSAfqowMSTK72LlTrktPb/2xYmKkVG3rVpEKNgSV9oSMLmj0/81KqYuBV4Ep/jDM19TUSNXcO+9IiTXI5uaSSyS3FexFpzuwdSv8+9/Sy9Q40pCQIKH3p5+GxYtl1rRLHTQuTqZonXtucMLM+fmiS2SzyfslKkoc1j/+ITpVzXu86hz1vJ2wH+uwtbyj3sGhHZzb/2zum/BN5oyaQ0J0QusPFkrMni0JoHfflQTy0KEye9XV6Tx+fEPfQXm5eM2f/azpDsv1QWsLrWWYjyHodFjLSGt9xBlGCnkqK+GhhySP1bNnQzVdRQUsWCBCY3ff3b0E2NyhtTxHO3fKpi0rS6qIfPG8aC2RgdTUlmHnqioZURoRIa9VRkZDlKKmRqoZ7Xa44IIWd+tX9u2Dxx6TDW5jkbrYWLHxwAH5+b33wraiLVjzrTy76VmKqorISsrinqn3cPv42xmWPiywhntCaykr3bpVnuz0dMjJadmjYLHA9deL2NLHH8OuXRL337tX3hCRkZJAdjjkRf3pT+XI1Jj2SN2aHVlI0ClxO611ta8M8SeLFsmurnk1XGKifNB37YIXXpB5wt2VI0dkJ7x/v+zEIyJkVxwdLY2vF17YuR360aNStu5uDPbOnRKSTk6W/q5DhxoiD7Gxko98/nnptUry71jfJixZIn9/c8VSF+l9S3j76Au8+LiVzcVribJEccXIK8gbn8eMITOCOnXMLSUl8N//ijNQShZ1mw0WLpRY3dVXt5zC07evOAYXdru8YPv2iXMZMEBCZO6m9wwb1lCJ1Fr3osMh1zQONRmCRoi9Y33PyZNyAmitgVIpOfl+8olo7bSnmTNcOHEC/vxn+dwOHNh04a+tlfXCbnffSOUtZWXuJZ1ra2Wn7ToRREbSYph8dLQ8/tq1gTslVFTA+vUt1Rg0DvaxknysbFevYsuooW/Z6Txy0SPcNPYmMuI70AgWCCor4cEHRc+o+Ytss4nMRVWVKBB68vwRESJZMWpU24+Zmirx2NWr3e8EQIT/JkwwIwRDhLB3CDt3ykbGU/LY1WOzc6fsQrsb//ufhIvdSdHExMhn+eWX4ayzmvYmHT0qidbDh2UnP3Gim0Rro/txV71YWSn/ul4fu9199CA+Xgp4AukQXEoTACUUstE5d6xE7SNGpzCePIaX53Fa6gTuOjNEE8QuPvpIjl7uugMjI+X2lSul3MuXHYQ33CCPu3u3ZONdGujV1fIG6t+/m8jgdg3C3iHU1Hh3ndayW+1ulJXJCSorq/VroqLEYX7xhVTX1NdLGO6jj2TBjI+XTebHH0tI+oc/bKmf1r+/nL4qK5uGYFy6ay4cDvfimW05dV8TGwt1uobN+nUK1Hz28j4ozWB9IRfoPzOSK4kijqKawIaxOoTdLsnhnh5mJlss8kKvXCkzYH1FfDz8/Ocy2nPZsoaZsvHxEoucNq31mJwh4IS9Q3Cp/7aFS4yyu1FUJP+2JVAXHy/5RK3hmWdkMlp2dstFurgY/vpXkbRprEoQESGFKwsWSC7H9XuuHi67XTaNKSnuNY+qqiRU7W+01mw4soGn8628MvB5aighRQ/kPH7LeH0bqWQ3ub6iQqIiIU1FhVQCpaV5vi4lRXbyviY2VgZJz5gheQxXzbG7vIMhqIT9KzJ6tMSga2tbL2SoqZEFb6Q3Qt9hRvMdemtoLYv6oUOSb3HnDEAW84MHYenSlkn688+XXOTKlQ19W1FRcjrZvl3CyI1L211UVcma4s8y9aKqIp7b9BzWAiubjm0iJiKG6f2uoe6LPM7InEZUZMs/9uRJORGNHes/u3yC60Vu3FjmDteL7C8iIzsmtmcIGGHvEGJj4corpUpl4MCWmxKbTRa52293H/sOd1wjLz2J04EsyqNHizOIjPQcvundW/KIc+c2jQZERIiTGDtWHMa+fXI/vXuLs46Pb1qSqrWEtIqL4Qc/8H1ZsN1hZ/me5VgLrLyx4w3qHfXkZuXyxCVPcP2Y60mNTWNJL8mfxMeLw7JYZANx/Lj8bXff3b7qyqCQlCRPslNnqVVOneoCxx2DPwkJh6CUehCYDdQBe4B5WusSX93/RRdJ7HrJEr4eSqK1nF7tdgllBrrGPVSIjZWS0iVLWs8lVlbKYpyTI6GitqaeRUbK81ta2jI8bLE0SPVXVsrzn5AgDmfxYul9cm1ktZZ17Gc/k45lX7G7eDfz80VU7lD5IdLj0rlz0p3My5nH2F5Nt/uXXio9We++K7OhQZzD5ZfDeee1HYUJCZSSP+TJJ8U5uDsl1NXJv2efHVjbDCFFSDgE4D3gXq21TSn1N+Be4Be+unOLBebMkSqZVatkyhfIWNlzzgn+BECt5aRisfj3xN4al1wiqsT790v4xnWKcjnNsjL40Y/EecTEtD3/wPW7nv4WpZo6luRk+Pa35VTx1VfyfKSnSzewLzqUK+sqeWXbK1gLrKwqXIVFWZg1dBaPznqU2SNmEx3hfpuvlIQSR46UNbO+Xpxjl5M8OfNM0QjJz5fegsbHmooKOfLceqvnxLMh7FHamwByAFFKXQXM0Vrf1Na1ubm5et26dQGwyj9UV0uFzzvvSC8ASDhl5kwp8w6kVENFhUjXfPxxQ07B4ZCS0xtuaEjofvKJSEx4msJYXi7O4K9/De7CqbVmzcE1WPOtvLj1RcrryhnaYyh54/O4ddyt9E3uGzzjgkF9vUhOv/uu/B/kxc7IkB2TuwSOISxRSq3XWue2uD0EHcJbwIta60VtXduVHUJJichp7N8vsenERFmAi4pkcb74YmkQDfTns7xcduh2uyR+BwxoakNVlagUxMW5L7fUWqqRvvENSSIHg6MVR3l247NYC6zsKNpBfFQ8c0fPJW98HmcPODt0ReUCRU2NaJTU1srRbPBg/3puh0PkAFatkqaVuDiRxp0woaEvwRBQgu4QlFLvA+50fu/TWr/hvOY+IBe4WrdimFLqDuAOgAEDBkwsLCx0d1lIo7XsnvfuldN7c+x2kdr4xjckTh1qbN0KDz8sUQdXohUkJ3D0qITmvv3twIa/6u31LN21FGuBlSVfLsGu7UzpP4W88XnMHT2XpJhQbxYIUyor4YknJCYZFycJo/p62XkkJMBdd4nEhSGgBN0htIVS6jbgO8B0rXWVN7/TVU8IX30Fv/99SwWBxrjkGx54IDTj1fv2SYfzpk1in8Mhm81LL5Veo0CVmG87sY35+fNZuGkhxyuP0zuxN7eOvZV5OfMYmdEN64hDCYdDjsHbt0tnYvM3e2mpOIzf/z74ibxuRmsOISSSykqpWUgS+TxvnUFXZv16WTA9RS4SEyWcdOCA53h9sMjOlkRzcbGEv1z9BIE4FZTVlvHilhexFlhZc3ANkZZIZg+fTV5OHrOGzgo9Ubnuyq5dcjLIznb/Zk9JkZ3Pu+/6tjva0GFC5ZPzLyAGeM8Z312jtf5OcE3yH6Wl3tWuWyySeA5levRw31nsa7TWrCpchbXAystbX6baVs2ozFE8NPMhbh57Mz0TTHVMyPHRRxIm8rTz6dVLmlauuy489edtNti2Teqpq6rk750yxf2JKQQICYegtR4abBsCSXp627pJWksuoa2a/3DnYNlBnil4hvkF89lzag/JMcncOu5W8nLymJQ1ySSIQ5kjR9rWKYqMlNBSRUX4OYRDh+DRR6WEMDZWjtFbtoim08SJ8M1vhtzfHBIOobsxaZLE3z0pCZSVScLZXdI53Km11fLmzjexFlhZvmc5Du1gWvY0fnveb7lm1DXER5nKlC5BXJzoe3jCJakRbjIBLlEvrVvGfLWWuLHNJkn1EEoSGocQBPr2lU7d9etblnWCNECdPCnjebvTBnjj0Y1Y860s2ryI4upi+iX3475z7uP28bczOG1wsM0ztJcpU6RpxVNM8dQpKXsNN2XJDz6QEJG7QSxKiZMoKBAxweHDA25eaxiHECTy8iQ/sGWL1PMnJzf0Idjt4gy6w8zx4upiFm9ejLXAyoYjG4iOiOaqkVeRl5PH9EHTibAEoXXb4BsmTJBRhKWl7hd8u10qEm6/Pbx2PvX14hAay/02Ryk5Qa1YYRyCQfpx7r5b8k3Ll0vfQWSklGyed577YTXhgt1h58OvPsRaYOX17a9Ta68lp3cOj138GDeefiM94gKQpTb4n/h4KUV74AHJEfTq1SB0deqUfM2eLSJZ4URFhTiFtipHkpKkjDCEMA4hiERGilRFyMsn+4ivTn3FgoIFLNi4gP2l+0mLTeOOiXcwb/w8cvqE2aJgEIYOlT6Dd9+VaiKHQxzC4MFyMsjJCa/TATQkytuSG7fZQm5mr3EIBr9SVV/Fa9tfw5pvZcW+FSgUM4fM5MEZD3L5iMuJjYxt+04MXZs+fWTxv+462T1HR8tCGG6OwEVioji8oiLPcrglJaJRE0IYh2DwOVpr1h5eizXfyuItiymrLWNw2mDun3Y/t427jf4pbhJthvAnLi7kyiz9glIiIfzoo5I7cVdFVFUlJ4nJkwNvnweMQzD4jOOVx1m0aRHWfCtbT2wlLjKOOaPmkJeTx7kDz8WiQqe8zmDwKxMmyMjQ5ctFUtylBOmqHKmuluHjIVZdZRyCoVPYHDaW7V6GNd/KW1++hc1hY3Lfyfznsv9w3ejrSIkNrTe8wRAQlIKbbpIB4m+/LVUjLtGv00+HK66AIUOCbWULjEMwdIidRTuZXzCfhRsXcqTiCJnxmdw1+S7mjZ/H6J6jg22ewRB8LBaZQDdlChw71iA3Hgitlw5iHILBa8pry3l528tY862sPrCaCBXBJcMuIS8nj0uHXUpURJh1mxoMvsBi6TJqrsYhGDyitWb1gdVY8628tPUlKusrGZE+gr9d+DduGXsLfZK6xhvdYDC0jXEIBrccLj/Mwo0LseZb2VW8i8ToRK4fcz15OXmc1e8sIypnMIQhxiEYvqbOXsfbX76NNd/KO7vfwaEdnDPgHH55zi+ZM2oOidHdXHrVYAhzjEMwsOX4Fqz5Vp7d9CxFVUVkJWVxz9R7uH387QxLN+MNDYbugnEI3ZSSmhJe2PIC1nwraw+vJcoSxRUjryBvfB4zhswwU8cMhm6I+dR3Ixzawcp9K7HmW3l1+6vU2Go4vefpPHLRI9w09iYy4jOCbaJX2O2wcyd8+KHMIImNhTPPlKbP1NRgW2cwdF2MQ+gGFJYU8sxGmTq2r2QfKTEp5I3PIy8njwl9JnSpBHFlJTz+OGzdKmKaSUmirvzCC/DKK/D978O4ccG20mDomhiHEKbU2Gr4347/Yc238v7e99FoLhx8IX++4M9cOfJK4qK6nqaM1vDvf8OOHS3nticni7N45BH4zW+kQdRgMLQP4xDCCK01+UfzseZbeW7zc5TUlDAwZSC/Pe+33Db+NrJTs4NtYqf46ivYvFmGTbk71CQkiJjmW2+JTIzBYGgfxiGEASerTvLc5uew5lvZeGwjMRExXDPqGvLG5zFt0LSwEZX75BNRTvYU4crMhPz81od0GTpIeTls2iRDbeLjYfRozxPBDF0S4xC6KHaHnff2voc138obO9+gzl5HblYuT1zyBNePuZ60OA867B2kogL27ZOkbkYGZGUFVtL+2LG21ZMtFvkqLzcOwSfY7fD667BsmQx0iYiQ20AUPefNa1DyNHR5QsIhKKXuB64AHMBx4Hat9eHgWhWa7C7ezfz8+Tyz8RkOlR8iPS6d7+V+j3k58xjbyz+j1yoq4NVX4eOPJY7v+hoyBG64IXCijYmJMpnQEy7b2ppeaPACrWHRIpkPPGCA6Pe7cDhg40Z46CH4xS+6x5yDbkBIOATgQa31rwGUUj8EfgN8J7gmhQ6VdZW8su0VrAVWVhWuwqIszBo6i0dnPcrsEbOJjvDf6ldRAX/7m5R3ZmU1rAlay479T3+Cn/0MTjvNbyZ8zZlnwuefe76mtBT69pXQkaGT7NsnQ+Czs1sOebFYoH9/Sex8+ilMnx4MCw0+JiQcgta6rNG3CYAOli2hgtaaNQfXYM238uLWFymvK2doj6H8+YI/c+u4W+mb3Dcgdrz1Fhw8KIncxigF6emyE3/8cXj4Yf/vyseMkVBVUZH82xy7HU6ehBtvDN/pjAFl5Up5Ud1N/HKRmQlLl8K0aZ6vM3QJQsIhACil/gTcCpQC0zxcdwdwB8CAAQMCY1wAOVpxlGc3Pou1wMqOoh3ER8Uzd/Rc8sbncfaAswPaM1BVJRvErKzWr0lKkkV40ybIzfWvPVFR8KMfyYll/37JacbEyGnl5EkoK4NLL4VJk/xrR7dh5862O/0SE+XFqKqS/xu6NAFzCEqp94Hebn50n9b6Da31fcB9Sql7ge8Dv3V3P1rrJ4EnAXJzc8PiJFFvr2fprqVYC6ws+XIJdm1nSv8pPDX7KeaOnktSTHCSdocPSx4xqo0xBzExsG2b/x0CQL9+8Pvfi6N6/32oq5Nw9ogRMq987FhzOvAZSom39YQraWOe9LAgYA5Ba32hl5c+DyyhFYcQTmw/sR1rvpWFmxZyvPI4vRJ68ZOzfsK8nHmMzBgZbPOw2737nFssDYUngaBHD7jmGplCWFkpeY2EhMA9frdh3Djxup6e3LIyOULGxwfOLoPfCImQkVJqmNZ6l/Pby4EdwbTHn5TVlvHilhexFlhZc3ANkZZILht+GXnj85g1dFZITR3r2VM2fw6H5/BwdbXkHQNNZKQpLfUr554r5ab19e6Pia5Y3Zw55oQQJoSEQwD+qpQagZSdFhJmFUZaa1YVrsJaYOXlrS9TbatmVOYo/j7j79w89mZ6JYZmg09ampSab9rUeh6hrk4W5kCEiwwBJitLFvsXX5QRkI1PAfX1Um2QkyOqgoawICQcgtb6mmDb4A8Olh3kmQIRldtzag9J0UncMvYW8nLyOKPvGV1CVO6aa0RI7uRJqSpqTG2trAm33GJ6k8KWSy8VoahXX4UTJxpuj4qSn115ZdP+BEOXRum2kkYhTG5url63bl2wzWhCra2WN3e+ibXAyvI9y3FoB9OypzFv/DyuGXUN8VFdL9Z64AA88QQcOSKNqhZLQ7J57lwpQe8Cvs3QGWw22L1bcgYxMTBsmMkbdGGUUuu11i3O9cYh+IiNRzdizbeyaPMiiquL6Zfcj3nj53H7+NsZnDY42OZ1GocDdu2C7dslTNSvH4wfb9YEg6Er0ppDMGe9TlBcXczizYuxFljZcGQD0RHRXDXyKvJy8pg+aDoRlohgm+gzLBYp7RwxItiWGAwGf2EcQjtxaAcf7P0Aa4GV17e/Tq29lvG9x/PYxY9x4+k30iOuR7BNNBgMhg5hHIKXfHXqKxYULGDBxgXsL91PWmwad0y8g3nj55HTJyfY5hkMBkOnMQ7BA9X11by2/TWsBVY+/OpDFIqZQ2by4IwHuXzE5cRGxgbbRIPBYPAZxiE0Q2vNusPrsOZbWbxlMaW1pQxKHcT90+7n1nG3MiAl/PSTDAaDAYxD+JoTlSdYtGkR1gIrW45vIS4yjjmj5pCXk8e5A88Nm6ljBoPB0Brd2iHYHDaW7V7G/IL5vLnzTWwOG5P7TuY/l/2H60ZfR0qs0UUwGAzdh27pEHYW7WR+wXwWblzIkYojZMZnctfku5g3fh6je44OtnkGg8EQFLqlQ7julevYcnwLlwy7hLycPC4ddmlIicoZDAZDMOiWDuGpy5+ib1Jf+iT1CbYpBoPBEDJ0S4eQm2WkOQ0Gg6E5pnTGYDAYDIBxCAaDwWBw0qXVTpVSJ5CBOi4ygKIgmdMaoWgTGLvaSyjaFYo2gbGrvQTDroFa68zmN3Zph9AcpdQ6d5KuwSQUbQJjV3sJRbtC0SYwdrWXULLLhIwMBoPBABiHYDAYDAYn4eYQngy2AW4IRZvA2NVeQtGuULQJjF3tJWTsCqscgsFgMBg6TridEAwGg8HQQYxDMBgMBgMQpg5BKfVTpZRWSmUE2xYApdT9SqlNSqkCpdRypVRWsG0CUEo9qJTa4bTtdaVUarBtAlBKXauU2qqUciilglqOp5SapZTaqZTarZS6J5i2uFBKWZVSx5VSW4JtS2OUUv2VUiuUUtudr99dIWBTrFLqC6XURqdNvw+2TY1RSkUopfKVUm8H2xYIQ4eglOoPzAD2B9uWRjyotR6rtR4PvA38Jsj2uHgPGKO1Hgt8CdwbZHtcbAGuBlYF0wilVATwOHAxMAq4QSk1Kpg2OVkAzAq2EW6wAT/RWp8GnAncGQLPVy1wgdZ6HDAemKWUOjO4JjXhLmB7sI1wEXYOAfgH8HMgZLLlWuuyRt8mECK2aa2Xa61tzm/XAP2CaY8LrfV2rfXOYNsBnAHs1lrv1VrXAS8AVwTZJrTWq4DiYNvRHK31Ea31Buf/y5GFrm+QbdJa6wrnt1HOr5D4/Cml+gGXAk8F2xYXYeUQlFKXA4e01huDbUtzlFJ/UkodAG4idE4IjckD3gm2ESFGX+BAo+8PEuQFrquglMoGcoDPg2yKKyxTABwH3tNaB90mJ48gm1dHkO34mi4nf62Ueh/o7eZH9wG/BGYG1iLBk11a6ze01vcB9yml7gW+D/w2FOxyXnMfctx/LhA2eWtXCKDc3BYSu8tQRimVCLwK/KjZ6TgoaK3twHhnjux1pdQYrXVQ8y9KqcuA41rr9Uqp84NpS2O6nEPQWl/o7nal1OnAIGCjUgok/LFBKXWG1vposOxyw/PAEgLkENqySyl1G3AZMF0HsCmlHc9XMDkI9G/0fT/gcJBs6RIopaIQZ/Cc1vq1YNvTGK11iVJqJZJ/CXZCfipwuVLqEiAWSFZKLdJa3xxMo8ImZKS13qy17qm1ztZaZyMf5gmBcAZtoZQa1ujby4EdwbKlMUqpWcAvgMu11lXBticEWQsMU0oNUkpFA9cDbwbZppBFyU7saWC71vrhYNsDoJTKdFXPKaXigAsJgc+f1vperXU/51p1PfBhsJ0BhJFDCHH+qpTaopTahIS0gl6O5+RfQBLwnrMk9t/BNghAKXWVUuogcBawRCn1bjDscCbcvw+8iyRIX9Jabw2GLY1RSi0GPgNGKKUOKqW+EWybnEwFbgEucL6fCpw74GDSB1jh/OytRXIIIVHiGYoY6QqDwWAwAOaEYDAYDAYnxiEYDAaDATAOwWAwGAxOjEMwGAwGA2AcgsFgMBicGIdgMBgMBsA4BEOYoJTKVkpVOzVrXLe1kK5WSsU56+PrOiuP7ryvj5yqqCilfuiUfm6XBIhSKlUp9b3O2OLFY7SQzFZKRSulVimlupxigcE/GIdgCCf2OCXGW5Wu1lpXO6/xhQRFHvCaUysH4HvAJVrrm9p5P6nO320XSvD2M7yAZpLZTgXXD4Dr2vvYhvDEOARDl8E5fGWG8/9/VEr908PlgZCuvglwCQT+GxgMvKmUulspdbNzMEuBUuo/jU4R/1NKrXcOa7nDeT9/BYY4r33QedppvJP/qVLqd87/ZztPIU8AG4D+rT1WYzxIZv/P+XcYDMYhGLoUv0UUY29CpJXv9nCtX6WrndpGg7XW+wC01t9BTh3TgGXIrnuq8zRip2HRzdNaTwRygR8qpdKBe3CebrTWP/Pi4UcAC7XWOUC8h8fyhi3ApHZcbwhjTOzQ0GXQWq9yCqj9GDjfFapRSt2PiKo1xt/S1RlASSs/mw5MBNY6lXfjEC1+ECdwlfP//YFhQHsFGAu11mu8eKw20VrbnfmUJOdQG0M3xjgEQ5fBKXHeByhyLV5Kqd64fx+3W7paKXUn8C3nt5cAVzX+Xmvd+PerEdlit3cFPKO1bjKS1Kl7fyFwlta6yinF7O4+bDQ9vTe/prKtx2onMUBNJ37fECaYkJGhS6CU6oMM8LkCqFRKXeT8UQ5Q4OZX2i1drbV+3Bm2Ga+1Ptz8+2bXngIilFLuFvQPgDlKqZ5O23sopQYCKcAppzMYicwdBihHVGddHAN6KqXSlVIxyLyK1mjtsbzCGbI6obWu9/Z3DOGLcQiGkEcpFQ+8hgxw3w7cD/zO+ePxuHEIAZKuXg6c7eaxtwG/ApY7ZZffQ042y4BI5233I3Os0VqfBFY7JdIfdC7Of0DGT76NB/1+D4/VBA+S2dOApR354w3hh5G/NnRplFJPI2GdAcDbWusxXv7ePiBXa13UicfOAX6stb6lo/cRbJRSrwH3aq13BtsWQ/AxJwRDl0Zr/Q2ttQOprklp3JjmDldjGhBFJ4eba63zkeErLco8uwLOUNr/jDMwuDAnBIPBYDAA5oRgMBgMBifGIRgMBoMBMA7BYDAYDE6MQzAYDAYDYByCwWAwGJwYh2AwGAwGwDgEg8FgMDgxDsFgMBgMAPw/B/f7IPKRLS0AAAAASUVORK5CYII=",
1278 "text/plain": [
1279 "<Figure size 432x288 with 1 Axes>"
1280 ]
1281 },
1282 "metadata": {
1283 "needs_background": "light"
1284 },
1285 "output_type": "display_data"
1286 }
1287 ],
1288 "source": [
1289 "plot_dataset(train_x,train_labels,net.W.detach().numpy(),net.b.detach().numpy())"
1290 ]
1291 },
1292 {
1293 "cell_type": "markdown",
1294 "metadata": {
1295 "id": "1W4TZfXOmIlS"
1296 },
1297 "source": [
1298 "Not let's compute the accuracy on the validation dataset:"
1299 ]
1300 },
1301 {
1302 "cell_type": "code",
1303 "execution_count": null,
1304 "metadata": {
1305 "colab": {
1306 "base_uri": "https://localhost:8080/"
1307 },
1308 "id": "HUjdeIefsIsg",
1309 "outputId": "a1a363d4-a307-4769-9ccf-fe8a857b62af"
1310 },
1311 "outputs": [
1312 {
1313 "data": {
1314 "text/plain": [
1315 "tensor(0.7333)"
1316 ]
1317 },
1318 "execution_count": 31,
1319 "metadata": {},
1320 "output_type": "execute_result"
1321 }
1322 ],
1323 "source": [
1324 "pred = torch.sigmoid(net.forward(torch.tensor(valid_x)))\n",
1325 "torch.mean(((pred.view(-1)>0.5)==(torch.tensor(valid_labels)>0.5)).type(torch.float32))"
1326 ]
1327 },
1328 {
1329 "cell_type": "markdown",
1330 "metadata": {
1331 "id": "Fv7JxC3uToPe"
1332 },
1333 "source": [
1334 "Let's explain what is going on here:\n",
1335 "* `pred` is the vector of predicted probabilities for the whole validation dataset. We compute it by running original validation data `valid_x` through our network, and applying `sigmoid` to get probabilities.\n",
1336 "* `pred.view(-1)` creates a flattened view of the original tensor. `view` is similar to `reshape` function in numpy.\n",
1337 "* `pred.view(-1)>0.5` returns a boolean tensor or truth value showing the predicted class (False = class 0, True = class 1)\n",
1338 "* Similarly, `torch.tensor(valid_labels)>0.5)` creates the boolean tensor of truth values for validation labels\n",
1339 "* We compare those two tensors element-wise, and get another boolean tensor, where `True` corresponds to correct prediction, and `False` - to incorrect.\n",
1340 "* We convert that tensor to floating point, and take it's mean value using `torch.mean` - that is the desired accuracy "
1341 ]
1342 },
1343 {
1344 "cell_type": "markdown",
1345 "metadata": {
1346 "id": "_95qF9lY2kHp"
1347 },
1348 "source": [
1349 "## Neural Networks and Optimizers\n",
1350 "\n",
1351 "In PyTorch, a special module `torch.nn.Module` is defined to represent a neural network. There are two methods to define your own neural network:\n",
1352 "* **Sequential**, where you just specify a list of layers that comprise your network\n",
1353 "* As a **class** inherited from `torch.nn.Module`\n",
1354 "\n",
1355 "First method allows you to specify standard networks with sequential composition of layers, while the second one is more flexible, and gives an opportunity to express networks of arbitrary complex architectures. \n",
1356 "\n",
1357 "Inside modules, you can use standard **layers**, such as:\n",
1358 "* `Linear` - dense linear layer, equivalent to one-layered perceptron. It has the same architecture as we have defined above for our network\n",
1359 "* `Softmax`, `Sigmoid`, `ReLU` - layers that correspond to activation functions \n",
1360 "* There are also other layers for special network types - convolution, recurrent, etc. We will revisit many of them later in the course.\n",
1361 "\n",
1362 "> Most of the activation function and loss functions in PyTorch are available in two form: as a **function** (inside `torch.nn.functional` namespace) and **as a layer** (inside `torch.nn` namespace). For activation functions, it is often easier to use functional elements from `torch.nn.functional`, without creating separate layer object.\n",
1363 "\n",
1364 "If we want to train one-layer perceptron, we can just use one built-in `Linear` layer:"
1365 ]
1366 },
1367 {
1368 "cell_type": "code",
1369 "execution_count": null,
1370 "metadata": {
1371 "colab": {
1372 "base_uri": "https://localhost:8080/"
1373 },
1374 "id": "D77pXPR6oFRs",
1375 "outputId": "efa49e5c-72d4-4781-89d4-4ab6597d2b0e"
1376 },
1377 "outputs": [
1378 {
1379 "name": "stdout",
1380 "output_type": "stream",
1381 "text": [
1382 "[Parameter containing:\n",
1383 "tensor([[-0.0422, 0.1821]], requires_grad=True), Parameter containing:\n",
1384 "tensor([0.6582], requires_grad=True)]\n"
1385 ]
1386 }
1387 ],
1388 "source": [
1389 "net = torch.nn.Linear(2,1) # 2 inputs, 1 output\n",
1390 "\n",
1391 "print(list(net.parameters()))"
1392 ]
1393 },
1394 {
1395 "cell_type": "markdown",
1396 "metadata": {
1397 "id": "0tbe0Et_oiNo"
1398 },
1399 "source": [
1400 "As you can see, `parameters()` method returns all the parameters that need to be adjusted during training. They correspond to weight matrix $W$ and bias $b$. You may note that they have `requires_grad` set to `True`, because we need to compute gradients with respect to parameters.\n",
1401 "\n",
1402 "PyTorch also contains built-in **optimizers**, which implement optimization methods such as **gradient descent**. Here is how we can define a **stochastic gradient descent optimizer**:"
1403 ]
1404 },
1405 {
1406 "cell_type": "code",
1407 "execution_count": null,
1408 "metadata": {
1409 "id": "B4AxyrFMozh0"
1410 },
1411 "outputs": [],
1412 "source": [
1413 "optim = torch.optim.SGD(net.parameters(),lr=0.05)"
1414 ]
1415 },
1416 {
1417 "cell_type": "markdown",
1418 "metadata": {
1419 "id": "6eB8v58eo9pp"
1420 },
1421 "source": [
1422 "Using the optimizer, our training loop will look like this:"
1423 ]
1424 },
1425 {
1426 "cell_type": "code",
1427 "execution_count": null,
1428 "metadata": {
1429 "colab": {
1430 "base_uri": "https://localhost:8080/"
1431 },
1432 "id": "ups7nlV22ofp",
1433 "outputId": "503d8ae9-35f3-4ecb-e2ff-4da2ec2914eb"
1434 },
1435 "outputs": [
1436 {
1437 "name": "stdout",
1438 "output_type": "stream",
1439 "text": [
1440 "Epoch 0: last batch loss = 0.7596041560173035, val acc = 0.5333333611488342\n",
1441 "Epoch 1: last batch loss = 0.6602361798286438, val acc = 0.6000000238418579\n",
1442 "Epoch 2: last batch loss = 0.5847358107566833, val acc = 0.6666666865348816\n",
1443 "Epoch 3: last batch loss = 0.5263020992279053, val acc = 0.7333333492279053\n",
1444 "Epoch 4: last batch loss = 0.48015740513801575, val acc = 0.800000011920929\n",
1445 "Epoch 5: last batch loss = 0.4430023431777954, val acc = 0.8666666746139526\n",
1446 "Epoch 6: last batch loss = 0.41254672408103943, val acc = 0.8666666746139526\n",
1447 "Epoch 7: last batch loss = 0.3871781527996063, val acc = 0.800000011920929\n",
1448 "Epoch 8: last batch loss = 0.3657420873641968, val acc = 0.800000011920929\n",
1449 "Epoch 9: last batch loss = 0.34739670157432556, val acc = 0.800000011920929\n"
1450 ]
1451 }
1452 ],
1453 "source": [
1454 "val_x = torch.tensor(valid_x)\n",
1455 "val_lab = torch.tensor(valid_labels)\n",
1456 "\n",
1457 "for ep in range(10):\n",
1458 " for (x,y) in dataloader:\n",
1459 " z = net(x).flatten()\n",
1460 " loss = torch.nn.functional.binary_cross_entropy_with_logits(z,y)\n",
1461 " optim.zero_grad()\n",
1462 " loss.backward()\n",
1463 " optim.step()\n",
1464 " acc = ((torch.sigmoid(net(val_x).flatten())>0.5).float()==val_lab).float().mean()\n",
1465 " print(f\"Epoch {ep}: last batch loss = {loss}, val acc = {acc}\")"
1466 ]
1467 },
1468 {
1469 "cell_type": "markdown",
1470 "metadata": {
1471 "id": "vRLXEQ4Qrcvx"
1472 },
1473 "source": [
1474 "> You may notice that to apply our network to input data we can use `net(x)` instead of `net.forward(x)`, because `nn.Module` implements Python `__call__()` function\n",
1475 "\n",
1476 "Taking this into account, we can define generic `train` function:"
1477 ]
1478 },
1479 {
1480 "cell_type": "code",
1481 "execution_count": null,
1482 "metadata": {
1483 "colab": {
1484 "base_uri": "https://localhost:8080/"
1485 },
1486 "id": "5c6WsBhlrlIs",
1487 "outputId": "54de8404-4170-4a15-abba-039d06d5e946"
1488 },
1489 "outputs": [
1490 {
1491 "name": "stdout",
1492 "output_type": "stream",
1493 "text": [
1494 "Epoch 0: last batch loss = 0.48486900329589844, val acc = 0.7333333492279053\n",
1495 "Epoch 1: last batch loss = 0.41338109970092773, val acc = 0.800000011920929\n",
1496 "Epoch 2: last batch loss = 0.35756850242614746, val acc = 0.800000011920929\n",
1497 "Epoch 3: last batch loss = 0.31495171785354614, val acc = 0.800000011920929\n",
1498 "Epoch 4: last batch loss = 0.2824164032936096, val acc = 0.800000011920929\n",
1499 "Epoch 5: last batch loss = 0.2572754919528961, val acc = 0.800000011920929\n",
1500 "Epoch 6: last batch loss = 0.23751722276210785, val acc = 0.800000011920929\n",
1501 "Epoch 7: last batch loss = 0.2217157930135727, val acc = 0.800000011920929\n",
1502 "Epoch 8: last batch loss = 0.2088666558265686, val acc = 0.800000011920929\n",
1503 "Epoch 9: last batch loss = 0.19824868440628052, val acc = 0.800000011920929\n"
1504 ]
1505 }
1506 ],
1507 "source": [
1508 "def train(net, dataloader, val_x, val_lab, epochs=10, lr=0.05):\n",
1509 " optim = torch.optim.Adam(net.parameters(),lr=lr)\n",
1510 " for ep in range(epochs):\n",
1511 " for (x,y) in dataloader:\n",
1512 " z = net(x).flatten()\n",
1513 " loss = torch.nn.functional.binary_cross_entropy_with_logits(z,y)\n",
1514 " optim.zero_grad()\n",
1515 " loss.backward()\n",
1516 " optim.step()\n",
1517 " acc = ((torch.sigmoid(net(val_x).flatten())>0.5).float()==val_lab).float().mean()\n",
1518 " print(f\"Epoch {ep}: last batch loss = {loss}, val acc = {acc}\")\n",
1519 "\n",
1520 "net = torch.nn.Linear(2,1)\n",
1521 "\n",
1522 "train(net,dataloader,val_x,val_lab,lr=0.03)"
1523 ]
1524 },
1525 {
1526 "cell_type": "markdown",
1527 "metadata": {
1528 "id": "KzuIDqJ8sFYm"
1529 },
1530 "source": [
1531 "## Defining Network as a Sequence of Layers\n",
1532 "\n",
1533 "Now let's train multi-layered perceptron. It can be defined just by specifying a sequence of layers. The resulting object will automatically inherit from `Module`, e.g. it will also have `parameters` method that will return all parameters of the whole network."
1534 ]
1535 },
1536 {
1537 "cell_type": "code",
1538 "execution_count": null,
1539 "metadata": {
1540 "colab": {
1541 "base_uri": "https://localhost:8080/"
1542 },
1543 "id": "tBtytmEAsq-O",
1544 "outputId": "06ad840b-c2b7-409e-e01e-a9170548151d"
1545 },
1546 "outputs": [
1547 {
1548 "name": "stdout",
1549 "output_type": "stream",
1550 "text": [
1551 "Sequential(\n",
1552 " (0): Linear(in_features=2, out_features=5, bias=True)\n",
1553 " (1): Sigmoid()\n",
1554 " (2): Linear(in_features=5, out_features=1, bias=True)\n",
1555 ")\n"
1556 ]
1557 }
1558 ],
1559 "source": [
1560 "net = torch.nn.Sequential(torch.nn.Linear(2,5),torch.nn.Sigmoid(),torch.nn.Linear(5,1))\n",
1561 "print(net)"
1562 ]
1563 },
1564 {
1565 "cell_type": "markdown",
1566 "metadata": {
1567 "id": "5r5RbLB1s6YB"
1568 },
1569 "source": [
1570 "We can train this multi-layered network using the function `train` that we have defined above:"
1571 ]
1572 },
1573 {
1574 "cell_type": "code",
1575 "execution_count": null,
1576 "metadata": {
1577 "colab": {
1578 "base_uri": "https://localhost:8080/"
1579 },
1580 "id": "ogXKdcfIs_ND",
1581 "outputId": "957ccd8d-0076-4e9b-89f1-edc1de75f18e"
1582 },
1583 "outputs": [
1584 {
1585 "name": "stdout",
1586 "output_type": "stream",
1587 "text": [
1588 "Epoch 0: last batch loss = 0.5835739970207214, val acc = 0.800000011920929\n",
1589 "Epoch 1: last batch loss = 0.4642275869846344, val acc = 0.800000011920929\n",
1590 "Epoch 2: last batch loss = 0.35158076882362366, val acc = 0.800000011920929\n",
1591 "Epoch 3: last batch loss = 0.26132312417030334, val acc = 0.800000011920929\n",
1592 "Epoch 4: last batch loss = 0.19465585052967072, val acc = 0.800000011920929\n",
1593 "Epoch 5: last batch loss = 0.14735405147075653, val acc = 0.800000011920929\n",
1594 "Epoch 6: last batch loss = 0.11454981565475464, val acc = 0.800000011920929\n",
1595 "Epoch 7: last batch loss = 0.09244414418935776, val acc = 0.800000011920929\n",
1596 "Epoch 8: last batch loss = 0.07805468142032623, val acc = 0.800000011920929\n",
1597 "Epoch 9: last batch loss = 0.06894762068986893, val acc = 0.800000011920929\n"
1598 ]
1599 }
1600 ],
1601 "source": [
1602 "train(net,dataloader,val_x,val_lab)"
1603 ]
1604 },
1605 {
1606 "cell_type": "markdown",
1607 "metadata": {
1608 "id": "jY4R1XEGtEzJ"
1609 },
1610 "source": [
1611 "## Defining a Network as a Class\n",
1612 "\n",
1613 "Using a class inherited from `torch.nn.Module` is a more flexible method, because we can define any computations inside it. `Module` automates a lot of things, eg. it automatically understands all internal variables that are PyTorch layers, and gathers their parameters for optimization. You just need to define all layers of the network as members of the class:"
1614 ]
1615 },
1616 {
1617 "cell_type": "code",
1618 "execution_count": null,
1619 "metadata": {
1620 "colab": {
1621 "base_uri": "https://localhost:8080/"
1622 },
1623 "id": "SlsJmGu0tMsZ",
1624 "outputId": "240d5c89-096c-4392-99cd-1ade5ff3e3e1"
1625 },
1626 "outputs": [
1627 {
1628 "name": "stdout",
1629 "output_type": "stream",
1630 "text": [
1631 "MyNet(\n",
1632 " (fc1): Linear(in_features=2, out_features=10, bias=True)\n",
1633 " (func): ReLU()\n",
1634 " (fc2): Linear(in_features=10, out_features=1, bias=True)\n",
1635 ")\n"
1636 ]
1637 }
1638 ],
1639 "source": [
1640 "class MyNet(torch.nn.Module):\n",
1641 " def __init__(self,hidden_size=10,func=torch.nn.Sigmoid()):\n",
1642 " super().__init__()\n",
1643 " self.fc1 = torch.nn.Linear(2,hidden_size)\n",
1644 " self.func = func\n",
1645 " self.fc2 = torch.nn.Linear(hidden_size,1)\n",
1646 "\n",
1647 " def forward(self,x):\n",
1648 " x = self.fc1(x)\n",
1649 " x = self.func(x)\n",
1650 " x = self.fc2(x)\n",
1651 " return x\n",
1652 " \n",
1653 "net = MyNet(func=torch.nn.ReLU())\n",
1654 "print(net)"
1655 ]
1656 },
1657 {
1658 "cell_type": "code",
1659 "execution_count": null,
1660 "metadata": {
1661 "colab": {
1662 "base_uri": "https://localhost:8080/"
1663 },
1664 "id": "HwdapRxft-7M",
1665 "outputId": "6eb900cf-4902-4a04-c62b-497b68455406"
1666 },
1667 "outputs": [
1668 {
1669 "name": "stdout",
1670 "output_type": "stream",
1671 "text": [
1672 "Epoch 0: last batch loss = 0.7821246981620789, val acc = 0.46666666865348816\n",
1673 "Epoch 1: last batch loss = 0.7457502484321594, val acc = 0.5333333611488342\n",
1674 "Epoch 2: last batch loss = 0.7120334506034851, val acc = 0.5333333611488342\n",
1675 "Epoch 3: last batch loss = 0.6811249256134033, val acc = 0.6666666865348816\n",
1676 "Epoch 4: last batch loss = 0.6533011794090271, val acc = 0.7333333492279053\n",
1677 "Epoch 5: last batch loss = 0.627849280834198, val acc = 0.7333333492279053\n",
1678 "Epoch 6: last batch loss = 0.6030643582344055, val acc = 0.800000011920929\n",
1679 "Epoch 7: last batch loss = 0.5775002837181091, val acc = 0.800000011920929\n",
1680 "Epoch 8: last batch loss = 0.5522137880325317, val acc = 0.8666666746139526\n",
1681 "Epoch 9: last batch loss = 0.5250465869903564, val acc = 0.8666666746139526\n"
1682 ]
1683 }
1684 ],
1685 "source": [
1686 "train(net,dataloader,val_x,val_lab,lr=0.005)"
1687 ]
1688 },
1689 {
1690 "cell_type": "markdown",
1691 "metadata": {
1692 "id": "dvAiaj_JndyP"
1693 },
1694 "source": [
1695 "**Task 1**: Plot the graphs of loss function and accuracy on training and validation data during training\n",
1696 "\n",
1697 "**Task 2**: Try to solve MNIST classificiation problem using this code. Hint: use `crossentropy_with_logits` as a loss function."
1698 ]
1699 },
1700 {
1701 "cell_type": "markdown",
1702 "source": [
1703 "## Defining a Network as PyTorch Lightning Module"
1704 ],
1705 "metadata": {
1706 "id": "7THJ0lhITxDi"
1707 }
1708 },
1709 {
1710 "cell_type": "markdown",
1711 "source": [
1712 "Let's wrap the written PyTorch model code in PyTorch Lightining module. This allows to work with your model more conveniently and flexibly using various Lightining methods for training and accuracy testing."
1713 ],
1714 "metadata": {
1715 "id": "bPpYZFQAXNMV"
1716 }
1717 },
1718 {
1719 "cell_type": "markdown",
1720 "source": [
1721 "First we need to install and import PyTorch Lightining. This can be done with the command\n",
1722 "\n",
1723 "```\n",
1724 "pip install pytorch-lightning\n",
1725 "```\n",
1726 "or\n",
1727 "```\n",
1728 "conda install -c conda-forge pytorch-lightning\n",
1729 "```"
1730 ],
1731 "metadata": {
1732 "id": "Crqwpx6gZUm3"
1733 }
1734 },
1735 {
1736 "cell_type": "code",
1737 "source": [
1738 "import pytorch_lightning as pl"
1739 ],
1740 "metadata": {
1741 "id": "_bBSXSELVlRK"
1742 },
1743 "execution_count": null,
1744 "outputs": []
1745 },
1746 {
1747 "cell_type": "markdown",
1748 "source": [
1749 "In order for our code to work in Lightning, we need to do the following:\n",
1750 "\n",
1751 "1. Create a subclass of `pl.LightningModule` and add to it model architecture in `__init__` method and `forward` pass method.\n",
1752 "2. Move used optimizer to the `configure_optimizers()` method.\n",
1753 "3. Define the training and validation process in methods `training_step` and `validation_step` respectively.\n",
1754 "4. (Optional) Implement a testing (`test_step` method) and prediction process (`predict_step` method).\n",
1755 "\n",
1756 "It should also be understood that PyTorch Lightning has a built-in translation of models to different devices, depending on where the incoming data from the `DataLoaders` is located. Therefore, all calls `.cuda()` or `.to(device)` should be removed from the code."
1757 ],
1758 "metadata": {
1759 "id": "_Aaz4FNpZjqL"
1760 }
1761 },
1762 {
1763 "cell_type": "code",
1764 "source": [
1765 "class MyNetPL(pl.LightningModule):\n",
1766 " def __init__(self, hidden_size = 10, func = torch.nn.Sigmoid()):\n",
1767 " super().__init__()\n",
1768 " self.fc1 = torch.nn.Linear(2,hidden_size)\n",
1769 " self.func = func\n",
1770 " self.fc2 = torch.nn.Linear(hidden_size,1)\n",
1771 "\n",
1772 " self.val_epoch_num = 0 # for logging\n",
1773 "\n",
1774 " def forward(self, x):\n",
1775 " x = self.fc1(x)\n",
1776 " x = self.func(x)\n",
1777 " x = self.fc2(x)\n",
1778 " return x\n",
1779 "\n",
1780 " def training_step(self, batch, batch_nb):\n",
1781 " x, y = batch\n",
1782 " y_res = self(x).view(-1)\n",
1783 " loss = torch.nn.functional.binary_cross_entropy_with_logits(y_res, y)\n",
1784 " return loss\n",
1785 "\n",
1786 " def configure_optimizers(self):\n",
1787 " optimizer = torch.optim.SGD(self.parameters(), lr = 0.005)\n",
1788 " return optimizer\n",
1789 " \n",
1790 " def validation_step(self, batch, batch_nb):\n",
1791 " x, y = batch\n",
1792 " y_res = self(x).view(-1)\n",
1793 " val_loss = torch.nn.functional.binary_cross_entropy_with_logits(y_res, y)\n",
1794 " print(\"Epoch \", self.val_epoch_num, \": val loss = \", val_loss.item(), \" val acc = \",((torch.sigmoid(y_res.flatten())>0.5).float()==y).float().mean().item(), sep = \"\")\n",
1795 " self.val_epoch_num += 1"
1796 ],
1797 "metadata": {
1798 "id": "0vp2ROQ9UHeE"
1799 },
1800 "execution_count": null,
1801 "outputs": []
1802 },
1803 {
1804 "cell_type": "markdown",
1805 "source": [
1806 "Let's also add validation `Dataset` and `DataLoader`:"
1807 ],
1808 "metadata": {
1809 "id": "tuWOgQabncMG"
1810 }
1811 },
1812 {
1813 "cell_type": "code",
1814 "source": [
1815 "valid_dataset = torch.utils.data.TensorDataset(torch.tensor(valid_x),torch.tensor(valid_labels,dtype=torch.float32))\n",
1816 "valid_dataloader = torch.utils.data.DataLoader(valid_dataset, batch_size = 16)"
1817 ],
1818 "metadata": {
1819 "id": "h3bAMM8RVckT"
1820 },
1821 "execution_count": null,
1822 "outputs": []
1823 },
1824 {
1825 "cell_type": "markdown",
1826 "source": [
1827 "Now our model is ready for training. In Pytorch Lightning, this process is implemented through an object of the `Trainer` class, which essentially \"mixes\" the model with any datasets."
1828 ],
1829 "metadata": {
1830 "id": "yj0Cd6OOnoyy"
1831 }
1832 },
1833 {
1834 "cell_type": "code",
1835 "source": [
1836 "net = MyNetPL(func=torch.nn.ReLU())\n",
1837 "trainer = pl.Trainer(max_epochs = 30, log_every_n_steps = 1, accelerator='gpu', devices=1)\n",
1838 "trainer.fit(model = net, train_dataloaders = dataloader, val_dataloaders = valid_dataloader)"
1839 ],
1840 "metadata": {
1841 "colab": {
1842 "base_uri": "https://localhost:8080/",
1843 "height": 864,
1844 "referenced_widgets": [
1845 "1657a223e5524ca682ea081b9e4addea",
1846 "4f111fbdbc3440f783adc3df3df46494",
1847 "cc048e2c91ce48258934ef577cf229d1",
1848 "d3c01678943341c5b814430145692a69",
1849 "9b55455cc9b541ef9634be2d790bb831",
1850 "15d7c09876074047afac1e41cb9ac121",
1851 "90137ba0ff814f71ad964f45d704ee89",
1852 "0919c9545ef64ed1a65f3f489d51cccc",
1853 "12cad77b8027415b82937ad33f793a63",
1854 "25ff491870eb4bf6ad4a320e5c99bd31",
1855 "238a42e032c34b9183e1e6a75f886da0",
1856 "a4fb1b2e0f8b4346bbde1b949dbce0fd",
1857 "18876b0e4f0f4b21ad1802f36637c067",
1858 "92ef8d6e24604b2f895e3876dc9996ee",
1859 "d4bc1057a59c4666a7dc0f9627c45901",
1860 "3355e659c40e4e42bbad6c8690f5055e",
1861 "0ab539031d80478685164ce470246d57",
1862 "271fdffaef854a67b294c0ccdfb6fe91",
1863 "0bd01bf4a9954fe2ba2760d10b9d7971",
1864 "bd5250b6001c4cd282a25d498ee4e673",
1865 "21538a0928e04ca08562dda0322385a1",
1866 "5301b071e422430e9bff6cd23c2853b5",
1867 "3e63509c89304bccb2c7371ec5e7ca62",
1868 "ff10f2e47185425eaa1229be76092ee5",
1869 "03cbfa5d29d548498035ba7bf7e0b659",
1870 "561c5a5b02894df2a66b2991877e1231",
1871 "569851b1958f49e281770b65bf78b60a",
1872 "2b49a1491afb4946975395080b9117e9",
1873 "79737a473e0b4b59bb4d6f190d92b94c",
1874 "d8a3af0177fc4707b928629952396ad5",
1875 "34852db50a91487795451f76b57da6b2",
1876 "046c75ea1598416497c2ef218d1f268a",
1877 "16e49dd0c2094a87a398416bac89ef69",
1878 "e6c4eb3c595c43ef9722654dcfabfcc6",
1879 "62f1b983740e47cd8664eccafc926e32",
1880 "9861f59fd71a4e3c879858ef8b4b40fb",
1881 "d9960d4519ec42bcb8678359b278c7b5",
1882 "118e90e145994312897584085642c03b",
1883 "db156fc5cbfd426e8460232b8f760733",
1884 "e68df50870c5469a9dc86346d7ad9a4e",
1885 "c89c5ec1ca1549cbbc7dd57b3672d74e",
1886 "84e423587f4244938844cd74d2f86dc0",
1887 "a31f6ff7fbc54df5bd1745816b2176f8",
1888 "d6d02c0963c54a6bbbd6753f3c3e6503",
1889 "69eedcfbe5c14a4cbe119364ce973690",
1890 "72eb0dd423f4486b9a63f100670e03a5",
1891 "4b7e9cfd822d48db848319a78548b0db",
1892 "a52a0bc61ed14e0d93f0c4768687fee8",
1893 "d1c60311d2bc4f4c826da5c7a634202d",
1894 "08426ffc99c44d6290ef9cb9363a5737",
1895 "161c5cea83dc42f6b87c904303dad688",
1896 "79c04563af9646dd9a7e82db11894c24",
1897 "235b2edd90bf4d1383b5a0d49905a241",
1898 "24ead65d14c54fbcb174b06b7dadbcc5",
1899 "20b85c48964d4c85890f8a0ebc04dd1d",
1900 "7287a9afffb5470c920734840c5d72fe",
1901 "ae3232c87db9469fa19cb59f78be2f57",
1902 "e2a292f657c342569a080a3d9e25852b",
1903 "f56858c5843d446286d416e9bbc7e7c8",
1904 "6ddb0e10ea78488aa8358ec3a7bb0780",
1905 "df7172162b6542f08662614b084d7521",
1906 "ca6221d153a94b4898e5a1b5043b843d",
1907 "54e9275a7f074eeca9a5995653d16036",
1908 "4454290d993f4350a6dc4e464c61c0a9",
1909 "6e5f99b5aec44fff9d4cecb28dd59188",
1910 "39ae0b5e8b8a41b79ea1a209f2aacc87",
1911 "08a690202bbe48bf9434a3354cb560c1",
1912 "7311cc83255f46ffa31f461c485111b5",
1913 "6f484c87ff3e4582aad771a703151f2b",
1914 "ab9c536f94b84922877071f760111f55",
1915 "427f04eec07f4d94a010664b12139f0f",
1916 "cd7f66fdfe224994a31a3c985cb7a1de",
1917 "b74e5502e4e54847b1191b7b0304f66a",
1918 "dbfcbe2df4f74df594606dd0bb6873b4",
1919 "ac62ad773e7a4694b57dd8c71b81f23d",
1920 "f20824d8dfc84640bee1cdc9b7277caa",
1921 "fd9a33d8f6ad459594d9939fd635730c",
1922 "e2900fe753754ede94abc1847dda4d5c",
1923 "0c1832e2d1ab4ca4a882d76f1d896c02",
1924 "10a5f4a004bc4a81a485604f67bab642",
1925 "fe260f7a9c66497cad723b44c1addbe7",
1926 "ef7d39cc71074a7faa299da2621abe03",
1927 "3f58e2aea843451b83e3aba8c1eefc74",
1928 "fd38fbd015e6471392cfee4464e6370e",
1929 "a95c45bcb67f4a569fb9f88af8108fde",
1930 "bf3bf33f0c474b54a4b472a4a7626da7",
1931 "afcc785f069b433ba8747b01e5840763",
1932 "ec27c6b290be4adc8d2df034fd3bb143",
1933 "0d2b1608b987468791e1a7ffedfd0079",
1934 "016a5fc3757c480b9c905867c4892864",
1935 "c7c7cc7d1c0647abb11ade78ef451007",
1936 "d0e4462fee034a67b3682e27d5cb6e27",
1937 "ac3a80de351440e7a279f3efce37e430",
1938 "d6204036abba495785a3674ea841746c",
1939 "3df8a54d12604c1ebe7229f88d5811bf",
1940 "5236935ed5874a0986f953ee21477be9",
1941 "1355273e058041efa299727d17949855",
1942 "68acf21436374d5eb393ada1b2298e28",
1943 "57d592b9768545869080fc2505e5a770",
1944 "b650b7b4420541298ea255d741f8a518",
1945 "3d0949a3f0504bf0802082ec86ce8e17",
1946 "3f71570951c94959ba0eea6692b2d671",
1947 "15f97cc51d594cca91dc43cbf019ffbc",
1948 "23e7ec609ed649e29f2c274bd76ee3dd",
1949 "47af905082094cd5b8a4cb4ab02ec431",
1950 "87aa955f31054e7da3fc1c93a8e1f335",
1951 "2f79b8377db841b5b14650ed14d7c5cb",
1952 "0560fb1045034e4b865a199dc0fba636",
1953 "e35861641d664e2ea8140ff988b65576",
1954 "4d683f5e6ccb4328bfd33829e05e2e35",
1955 "8eb84c34c1a54dad903371885051bef2",
1956 "424d7efa1e1d4c79a5a9e1e0eea97bc3",
1957 "0d6619a581884191a205c9e1b91b3790",
1958 "035553232bbc40c789c35bdcd78d7b88",
1959 "6648bcb6b46e4dc893654f139a7b73df",
1960 "d4302a261e334336b71459e74fee95a4",
1961 "5ae44fb9f67b40bb8261defbc07bf689",
1962 "5097652e46cf4d1d88933903e37387dd",
1963 "82e9918bb5b648058fe32b19b0ab7059",
1964 "28913620d1dc406db67ff7876db5d414",
1965 "2e5b502d9c0e47449a6e7b5095d5b6ec",
1966 "044439bda84b4d24935a46be5c14ca02",
1967 "3aa9793c2771435b892c70a5ca86a372",
1968 "490c7d65abaf46a1a6f781395f846b83",
1969 "b3ad1dfdecf649988c4060e76f0c9164",
1970 "6f0bd0ab209348d2a76ae70cfbfa47ff",
1971 "95dc3afa44174e9f8e715dab0a3dfd7d",
1972 "d2f7362dee2b4100930a7a1f288e649e",
1973 "c92364fa157f4212a9a9811925605382",
1974 "aec5035eeab04627b3d61c05bf53ef4f",
1975 "035f91d8fd1d4ff6932f9d01aa334f3a",
1976 "8a56ba2f8d384c0fb285ac9cf7b5e421",
1977 "675520bc1a7e4aca9e17f7410d6380cf",
1978 "9b19f80d8f5648b9b575515d2f8085f8",
1979 "c0065e721652472996f40eb47071589c",
1980 "b236adc069d049c288d81702cc0dd62c",
1981 "5eefa033732941b39bf3bfa62fd9185e",
1982 "5aefc7d586ae4be4aa33c1383f494b9f",
1983 "5e0c000321a64c28a81a1e167d88bd22",
1984 "438661c89c034656b86e936360474b24",
1985 "ed1fca3c73ad446db422e30f5ec44b0e",
1986 "4421eb7516c04af1972c6f5df5315bc4",
1987 "6d52bfaf6be54d90a53e1fb465dfaf7d",
1988 "3cd65d1d3cd0438ea94b8c4d964bc65c",
1989 "a4653a04856c47a0b1907d864e3f1a15",
1990 "02e9029cbe8a4db0b6ef00c4df0ae302",
1991 "258629893fa14d178577ee19efdff31e",
1992 "fe82872822b749ae87fac7eb4df0791e",
1993 "07655ba9152647df80ad1efe4b117135",
1994 "b6e87d03766a4185ad2c4d716aa456d7",
1995 "c6f304a0747d40fea9571f99f5289986",
1996 "5722085f090c4851a1cde4daf7db77df",
1997 "7aed32af8b134b56a041ebb25c32640c",
1998 "a723ce7408e14b63b6d4311051dca322",
1999 "3a9c42437ab34710a3fd3a75cf9cfac4",
2000 "80a0d8b6e16b4ceb98bb8911b0fa596c",
2001 "9310b29cec49404b8dfc9feb8e5bac9f",
2002 "44341f0cb29440a2bef7f711517a01ff",
2003 "9739202e0849427d9fe61210e231837c",
2004 "c43c9d3bbacf478b9fafc076ea58ad29",
2005 "abfa8dc54e654a61b93ec9a15f5fe67e",
2006 "979514f924c6441098f7b7231ae15900",
2007 "bbef9cf5cf2d42adb650caba73919e06",
2008 "3b8da849443f401bb51a038f5bb82ad9",
2009 "36f417b9e7e247b68e3bb18519af98b4",
2010 "71643356b8954af5ab6cdf03df2825e3",
2011 "8d50b1a8e0ce4d018fe4a51240ddb35d",
2012 "654d72723ed8474ca360102e896331d5",
2013 "049d95dcfbb34e84a0060919fdb8f454",
2014 "54955fa5560041c09f847a3afb39eecd",
2015 "34b2c78ef1254853a377efc6fead2e95",
2016 "4eda8d394bff4fbf98bc086737c75219",
2017 "4ca134b9e1df4136bd0d2660a82960cf",
2018 "87cf68c4e8a245c686fbbe439f176b87",
2019 "6009ded338de4e5b9a204e6f1243bf05",
2020 "f01a1f50e0a74faaacc35695590cea30",
2021 "a76a4846aa11422785c1d0218c94b827",
2022 "373e3dd821954f33becb388c82ffebc2",
2023 "9f532b8a64b3410f9a2e2a99755dac55",
2024 "b457e104ad194032ba15070b89d42e6e",
2025 "81fc3a7b94554a1980724ac6092fc88a",
2026 "68908006e8eb4b31a55d1c0be51453bd",
2027 "8f5c49525abe4d7a9ea746db18135f26",
2028 "70eb5ab30ffb4b5bbe58832c6386a536",
2029 "970d8a7e2b5c47a5bff8a036cadc9b84",
2030 "3ad7904ba48048bfa4b7a866cf4aa4a6",
2031 "a20c551e949842f881c6def753eb81ed",
2032 "67e1192ed6774aa9bb17f1d5a27695f9",
2033 "5aea05cbd78843bcb2a9d3df9e3abefd",
2034 "4693d306ecaf44f2b6b505ca072e22bb",
2035 "2e46fda9b283487ba4f118bad5a880c6",
2036 "55a8b90a0a6c44eda0bedd43fda69c41",
2037 "a7e64bcbd09644a198b9f1c7d8a8d1c6",
2038 "87a7b1169e1f404d81fddc56c0ba2145",
2039 "921d621e89a64e1aab62397758e26592",
2040 "da9024d63c56460b9ca061d5cd1bb985",
2041 "503e7b032b3d44d49e15587060b25e56",
2042 "1361830025974670a174df70957feabc",
2043 "6adb0fc2977b41e7bce4e81909c6c931",
2044 "ab9b58483e0145aab2f22a8bbf0422cf",
2045 "6725fd421a9344feb552ee1a1ce84dda",
2046 "0d712617055b45a3b6f5783dfe6a5842",
2047 "1c5fdfd620eb47c28dcb91ff04ea6155",
2048 "db2185de343a4f76a2b2ecfad4e658ad",
2049 "bb1efececaef471c90c3bc9cc2fb5ac7",
2050 "7a49920285474268b1cb3f57e73a450e",
2051 "b0e5dea19289434ebe98002e3cfe6086",
2052 "92a8cbc6f6344e49a455c9e3df2c552f",
2053 "b41986dd9910458e95ddfff0b1a508d1",
2054 "f2fb2d0dfed54272abbc0560a467c97e",
2055 "08c1e9701d0b4f2e8b34027af81ab586",
2056 "1ea2399f27404d5cbfffd68efbd472fc",
2057 "affc022e069a41af877cf9fbe3889012",
2058 "65490339b12e47d6b35cbf4a16d1bfeb",
2059 "10247683189c43b6abf3df0b7818bcd9",
2060 "10b0f64c86714778919d55c643550ff5",
2061 "a702202230484af5b32a4653f0eac288",
2062 "5e38b9f21ce04bcc820f711c9c47678d",
2063 "2771553d801f4961ad94344e2d5caacd",
2064 "134808b58f1f42b09c4b2353a94bbb0e",
2065 "02bda666a850468086acea36156397c7",
2066 "9abed88d016f4822bf19e71dcf997571",
2067 "6ea72db4ae8b45ec96508a51c21b6974",
2068 "7baafb061feb455e9b37622dc9a4c724",
2069 "ba06f72e44694ecd9fa51e984b4dc8bf",
2070 "136c4f60a8734c578129fd843ee7ab5f",
2071 "28f475b19b08458c81ee0cfb11c9d9c3",
2072 "604fd938ec7d41f285e1f1b9cb9c6eac",
2073 "07bb79027e20401e84d02a33a628b397",
2074 "288ab1d98c7a4e21af429773a9fe3534",
2075 "19a6a91b0d4e46d9be72aee530a974ce",
2076 "0de2ddf45f754c5991a62ae8e822c4b7",
2077 "a6fb10bec45f4f1a9243b466eb95c017",
2078 "44ce5ef7a8af4fb291da012fa53e0c5a",
2079 "9c40cc6348cb4bcfb59e0457399cd72b",
2080 "3f9455a7a52947638545cff45b1e807d",
2081 "22550ebc70ef4671a65bb1a041c9def7",
2082 "67f022dd80234c08849906615a1191dc",
2083 "2e5e169b1ad64407ad8c3494a70b314f",
2084 "277e7a95b41447b4a52824c212e6fa7c",
2085 "d07c7bcf6a934fae9e015be66a1f860d",
2086 "c5e484430b0843689d7cfb434d0aa8da",
2087 "814e2827e8d647069f05c5b4c89deb52",
2088 "0c8b616aecfd4e5e80a0b7c3aabd290f",
2089 "e0f4261c913d42c9a7dcdf79a9914d4a",
2090 "80a819740bb44d589858d4780b100255",
2091 "5caf7d1fdd564dc2bebe48dd918d9c8f",
2092 "10ab820d989c44b98a8bde85780c3deb",
2093 "7e787283e4434da6b5d3f9245745547c",
2094 "b8c86419aa4f43a3a0c9443f23298c0a",
2095 "0270acbb7ed94626adc932afa0655eaa",
2096 "ab0b7e4f05b24205b5e4b9e975cb8e71",
2097 "70c85ee15c0c4427b6538acbbd0de481",
2098 "b38c3345647c4db68a2321e3a4d9e215",
2099 "8c7b852936ca400aa04ec3f95e9afcb3",
2100 "3099fea4c655407582c196176cc2108c",
2101 "a5cb3ea273f9454fbb9dcd8877f2aa33",
2102 "b4a722f06b614e9cbb259c8fa1e9f664",
2103 "228014c8ccd543a6af4c554cf60137bf",
2104 "6e7ea147348f40c8acc919af41047189",
2105 "7c315c5b62e14d2c9af6fecf536d8df5",
2106 "a9e1b08f5ff24e1b8d652cd9ad649b54",
2107 "df097748d93e4254be82e6dae9696167",
2108 "ac30029d30c34fd58a7f3d1826d94d6b",
2109 "6daac3cee4b9409cba48efa0d06bee24",
2110 "db45da82b3594a1db11322289253a132",
2111 "d4891374cfde42adac3f2218b879f082",
2112 "2a009696a36748b2937ac6746460483a",
2113 "979c7269c8394082b277435040052f45",
2114 "42ff3dacbeb34fc79e60d382c93180d6",
2115 "d5156d7ec0e14a60bc67ac5e3c5b32a6",
2116 "e82400379100428a915968d7ba060fd5",
2117 "f25f7aabffb046a388ba71ad7c3ab7de",
2118 "5088dea18c1146d8841e50e76697b7e5",
2119 "e36d59055aee4a48b521109b96c9faff",
2120 "d4b061b8a44646a8b4ccc4839fe769a8",
2121 "354425d2d3cc4be4891499c8c252e585",
2122 "84c2e850cd944480bf1cc9bd79ca40f4",
2123 "ecb0caf0ebd2458789aee04fd0468723",
2124 "0689a7b924674988a587d498cb946549",
2125 "ea131342791043d48673da5ccb559c26",
2126 "6936e031b7f74f45998232f819666b45",
2127 "ae8efd2c29bb4008a13be5b0483928b4",
2128 "7728374b25ec4b45b3d9171e69173bf5",
2129 "a7456e34baef4c89979963a8e61b98e4",
2130 "1db1f8a2985947639120d9bccdf3208e",
2131 "ac7a77f2fd1b4cdaab3ae8ff2bb8b963",
2132 "2486dff82a4b41809b4a8ac2569b7e10",
2133 "bcb064131d464033be2a95b5df8e2c82",
2134 "4614b06d5a974ecf86238f938e58bccb",
2135 "7d3a28c174ff4c2791039495b544b507",
2136 "58a114346ac44a8c992da25fb7c721f8",
2137 "58e96bfc8f6a449eafa644edf4b75228",
2138 "3bafea3ba4b347e186da01e279f41084",
2139 "d8fa48e20376478e9e89438aa57de80d",
2140 "5d9aaed3cf2e451595690e72ed4c2495",
2141 "ab7aabf047e34d5899bc3dcfa972f7fd",
2142 "8a006c7b0f0d431c8c024aad2ea8e427",
2143 "cc122dc799da42948360712d0b809ed9",
2144 "d3186548246149feaa9228782d7adaab",
2145 "96660986fcd1451d8565790e961277b5",
2146 "e6d820247bfc42acbff367b5794b6655",
2147 "b7ff8b76997a4235a3205fac9c531502",
2148 "00e7a13db6174f3182a898345dd1d38d",
2149 "adcdbc5f4ee045a2bc8c7b3b7f4cac5b",
2150 "f4920d0dce6c4d2b8528f8b098722cfc",
2151 "51f3bf496ca146b18b93fb58846f591e",
2152 "78672ae9cde346c09d3a7f7701dfd151",
2153 "a866149ec74144b385f55fdf7eb105a8",
2154 "26b866aceb8342b5830ca76815d6fa73",
2155 "861f32fe95c04198b9dd81c8fa1fbacb",
2156 "963f20a5be194830b08bb215b9ee97a1",
2157 "ddeba74ba1ba4dd1a1c4f47c358eeae5",
2158 "7d8c57299000460680a250aa23c7b2cd",
2159 "4aced1e370fc4b2c88d4283bcbe97ebf",
2160 "44a36016b20647efa05d9aee60aaedb8",
2161 "9efd3613e80e4aa78248e979a44bd88b",
2162 "288cff3f48ab4cf2b27cfc5c37c716f7",
2163 "179d01e55e5142acaddfff4b1975860e",
2164 "db881594d4b9483bab4d09b536a6602a",
2165 "1b4e9bc9196d4c7e98005bc5de040202",
2166 "8754e0214d6c495ca4f7e75d11738f73",
2167 "3fbb5b3e332d4444ab7623422347d7ce",
2168 "85520aaa9c464b7f927c043a323e45f3",
2169 "bd18214cd9624c0c97d6e5d73bd84b9e",
2170 "67a7e78833b141778d290e31b5006277",
2171 "67139d0ae82f4ca7be9506a5bdd2f603",
2172 "73b4b4d832f446259513cff2c764a544",
2173 "442b0033175d4d38ac1633814f8919b3",
2174 "08664ffa89a04048aa7a6eecf55169a8",
2175 "d89e128b65424ced9d2ea19e42facb67",
2176 "6c135337a5db4da8867d9c9bb1bad8b2",
2177 "63b03fea35f64af49787d6253d1e8aa2",
2178 "5408ba6a5d5e4d3e8371e6d8a156aae6",
2179 "dce0aaa1839b493a8bfa93820f85bf0b",
2180 "aa01e299117447e692e719426dc7f53e",
2181 "1183926027a04b39a81c603be4b7860d",
2182 "edee1e5620214adcb701876812fd55df",
2183 "2ddca395a3ea42c6a422cea781e4262f",
2184 "8fc852abdc384fbfada6505cd96ea825",
2185 "239d49bd1d6c4cc2a95548c5634a3b9a",
2186 "40eaa223a6ef48628829d45f576c5293",
2187 "8a9155146377424cbc114127816ba8ba",
2188 "beda87842b744bd984629e34e8fae0b5",
2189 "1a4e7e57b95a41869ab5642ed0e6571c",
2190 "25b3cab0e79a4762a8cc170309e7489e",
2191 "9f2c5a74769249b997c1558bdf4c94ce",
2192 "71b773f3ead4430cbfac09127b801c6a",
2193 "d6e0253023874b6faa6bf6664e55e160",
2194 "5031681c504544388ece6bbfb3b5ad69",
2195 "34d4e2de5bea4b7f89d44a4e7fcedbb0",
2196 "1fd81f69f417476a95e4594e2c8b605d"
2197 ]
2198 },
2199 "id": "o3ebde8VWKdi",
2200 "outputId": "7c60f8aa-67e6-4343-c72e-d6e356d60e6c"
2201 },
2202 "execution_count": null,
2203 "outputs": [
2204 {
2205 "output_type": "stream",
2206 "name": "stderr",
2207 "text": [
2208 "GPU available: True, used: True\n",
2209 "TPU available: False, using: 0 TPU cores\n",
2210 "IPU available: False, using: 0 IPUs\n",
2211 "HPU available: False, using: 0 HPUs\n",
2212 "LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]\n",
2213 "\n",
2214 " | Name | Type | Params\n",
2215 "--------------------------------\n",
2216 "0 | fc1 | Linear | 30 \n",
2217 "1 | func | ReLU | 0 \n",
2218 "2 | fc2 | Linear | 11 \n",
2219 "--------------------------------\n",
2220 "41 Trainable params\n",
2221 "0 Non-trainable params\n",
2222 "41 Total params\n",
2223 "0.000 Total estimated model params size (MB)\n"
2224 ]
2225 },
2226 {
2227 "output_type": "display_data",
2228 "data": {
2229 "text/plain": [
2230 "Sanity Checking: 0it [00:00, ?it/s]"
2231 ],
2232 "application/vnd.jupyter.widget-view+json": {
2233 "version_major": 2,
2234 "version_minor": 0,
2235 "model_id": "1657a223e5524ca682ea081b9e4addea"
2236 }
2237 },
2238 "metadata": {}
2239 },
2240 {
2241 "output_type": "stream",
2242 "name": "stdout",
2243 "text": [
2244 "Epoch 0: val loss = 0.7213451266288757 val acc = 0.3333333432674408\n"
2245 ]
2246 },
2247 {
2248 "output_type": "display_data",
2249 "data": {
2250 "text/plain": [
2251 "Training: 0it [00:00, ?it/s]"
2252 ],
2253 "application/vnd.jupyter.widget-view+json": {
2254 "version_major": 2,
2255 "version_minor": 0,
2256 "model_id": "a4fb1b2e0f8b4346bbde1b949dbce0fd"
2257 }
2258 },
2259 "metadata": {}
2260 },
2261 {
2262 "output_type": "display_data",
2263 "data": {
2264 "text/plain": [
2265 "Validation: 0it [00:00, ?it/s]"
2266 ],
2267 "application/vnd.jupyter.widget-view+json": {
2268 "version_major": 2,
2269 "version_minor": 0,
2270 "model_id": "3e63509c89304bccb2c7371ec5e7ca62"
2271 }
2272 },
2273 "metadata": {}
2274 },
2275 {
2276 "output_type": "stream",
2277 "name": "stdout",
2278 "text": [
2279 "Epoch 1: val loss = 0.7164624333381653 val acc = 0.3333333432674408\n"
2280 ]
2281 },
2282 {
2283 "output_type": "display_data",
2284 "data": {
2285 "text/plain": [
2286 "Validation: 0it [00:00, ?it/s]"
2287 ],
2288 "application/vnd.jupyter.widget-view+json": {
2289 "version_major": 2,
2290 "version_minor": 0,
2291 "model_id": "e6c4eb3c595c43ef9722654dcfabfcc6"
2292 }
2293 },
2294 "metadata": {}
2295 },
2296 {
2297 "output_type": "stream",
2298 "name": "stdout",
2299 "text": [
2300 "Epoch 2: val loss = 0.7117107510566711 val acc = 0.3333333432674408\n"
2301 ]
2302 },
2303 {
2304 "output_type": "display_data",
2305 "data": {
2306 "text/plain": [
2307 "Validation: 0it [00:00, ?it/s]"
2308 ],
2309 "application/vnd.jupyter.widget-view+json": {
2310 "version_major": 2,
2311 "version_minor": 0,
2312 "model_id": "69eedcfbe5c14a4cbe119364ce973690"
2313 }
2314 },
2315 "metadata": {}
2316 },
2317 {
2318 "output_type": "stream",
2319 "name": "stdout",
2320 "text": [
2321 "Epoch 3: val loss = 0.7070826292037964 val acc = 0.3333333432674408\n"
2322 ]
2323 },
2324 {
2325 "output_type": "display_data",
2326 "data": {
2327 "text/plain": [
2328 "Validation: 0it [00:00, ?it/s]"
2329 ],
2330 "application/vnd.jupyter.widget-view+json": {
2331 "version_major": 2,
2332 "version_minor": 0,
2333 "model_id": "7287a9afffb5470c920734840c5d72fe"
2334 }
2335 },
2336 "metadata": {}
2337 },
2338 {
2339 "output_type": "stream",
2340 "name": "stdout",
2341 "text": [
2342 "Epoch 4: val loss = 0.7025845050811768 val acc = 0.3333333432674408\n"
2343 ]
2344 },
2345 {
2346 "output_type": "display_data",
2347 "data": {
2348 "text/plain": [
2349 "Validation: 0it [00:00, ?it/s]"
2350 ],
2351 "application/vnd.jupyter.widget-view+json": {
2352 "version_major": 2,
2353 "version_minor": 0,
2354 "model_id": "08a690202bbe48bf9434a3354cb560c1"
2355 }
2356 },
2357 "metadata": {}
2358 },
2359 {
2360 "output_type": "stream",
2361 "name": "stdout",
2362 "text": [
2363 "Epoch 5: val loss = 0.6982313990592957 val acc = 0.2666666805744171\n"
2364 ]
2365 },
2366 {
2367 "output_type": "display_data",
2368 "data": {
2369 "text/plain": [
2370 "Validation: 0it [00:00, ?it/s]"
2371 ],
2372 "application/vnd.jupyter.widget-view+json": {
2373 "version_major": 2,
2374 "version_minor": 0,
2375 "model_id": "e2900fe753754ede94abc1847dda4d5c"
2376 }
2377 },
2378 "metadata": {}
2379 },
2380 {
2381 "output_type": "stream",
2382 "name": "stdout",
2383 "text": [
2384 "Epoch 6: val loss = 0.6939730644226074 val acc = 0.2666666805744171\n"
2385 ]
2386 },
2387 {
2388 "output_type": "display_data",
2389 "data": {
2390 "text/plain": [
2391 "Validation: 0it [00:00, ?it/s]"
2392 ],
2393 "application/vnd.jupyter.widget-view+json": {
2394 "version_major": 2,
2395 "version_minor": 0,
2396 "model_id": "0d2b1608b987468791e1a7ffedfd0079"
2397 }
2398 },
2399 "metadata": {}
2400 },
2401 {
2402 "output_type": "stream",
2403 "name": "stdout",
2404 "text": [
2405 "Epoch 7: val loss = 0.6897947192192078 val acc = 0.2666666805744171\n"
2406 ]
2407 },
2408 {
2409 "output_type": "display_data",
2410 "data": {
2411 "text/plain": [
2412 "Validation: 0it [00:00, ?it/s]"
2413 ],
2414 "application/vnd.jupyter.widget-view+json": {
2415 "version_major": 2,
2416 "version_minor": 0,
2417 "model_id": "b650b7b4420541298ea255d741f8a518"
2418 }
2419 },
2420 "metadata": {}
2421 },
2422 {
2423 "output_type": "stream",
2424 "name": "stdout",
2425 "text": [
2426 "Epoch 8: val loss = 0.6857149004936218 val acc = 0.2666666805744171\n"
2427 ]
2428 },
2429 {
2430 "output_type": "display_data",
2431 "data": {
2432 "text/plain": [
2433 "Validation: 0it [00:00, ?it/s]"
2434 ],
2435 "application/vnd.jupyter.widget-view+json": {
2436 "version_major": 2,
2437 "version_minor": 0,
2438 "model_id": "8eb84c34c1a54dad903371885051bef2"
2439 }
2440 },
2441 "metadata": {}
2442 },
2443 {
2444 "output_type": "stream",
2445 "name": "stdout",
2446 "text": [
2447 "Epoch 9: val loss = 0.6817294359207153 val acc = 0.46666669845581055\n"
2448 ]
2449 },
2450 {
2451 "output_type": "display_data",
2452 "data": {
2453 "text/plain": [
2454 "Validation: 0it [00:00, ?it/s]"
2455 ],
2456 "application/vnd.jupyter.widget-view+json": {
2457 "version_major": 2,
2458 "version_minor": 0,
2459 "model_id": "044439bda84b4d24935a46be5c14ca02"
2460 }
2461 },
2462 "metadata": {}
2463 },
2464 {
2465 "output_type": "stream",
2466 "name": "stdout",
2467 "text": [
2468 "Epoch 10: val loss = 0.6778346300125122 val acc = 0.46666669845581055\n"
2469 ]
2470 },
2471 {
2472 "output_type": "display_data",
2473 "data": {
2474 "text/plain": [
2475 "Validation: 0it [00:00, ?it/s]"
2476 ],
2477 "application/vnd.jupyter.widget-view+json": {
2478 "version_major": 2,
2479 "version_minor": 0,
2480 "model_id": "675520bc1a7e4aca9e17f7410d6380cf"
2481 }
2482 },
2483 "metadata": {}
2484 },
2485 {
2486 "output_type": "stream",
2487 "name": "stdout",
2488 "text": [
2489 "Epoch 11: val loss = 0.6740307807922363 val acc = 0.46666669845581055\n"
2490 ]
2491 },
2492 {
2493 "output_type": "display_data",
2494 "data": {
2495 "text/plain": [
2496 "Validation: 0it [00:00, ?it/s]"
2497 ],
2498 "application/vnd.jupyter.widget-view+json": {
2499 "version_major": 2,
2500 "version_minor": 0,
2501 "model_id": "3cd65d1d3cd0438ea94b8c4d964bc65c"
2502 }
2503 },
2504 "metadata": {}
2505 },
2506 {
2507 "output_type": "stream",
2508 "name": "stdout",
2509 "text": [
2510 "Epoch 12: val loss = 0.6703100204467773 val acc = 0.5333333611488342\n"
2511 ]
2512 },
2513 {
2514 "output_type": "display_data",
2515 "data": {
2516 "text/plain": [
2517 "Validation: 0it [00:00, ?it/s]"
2518 ],
2519 "application/vnd.jupyter.widget-view+json": {
2520 "version_major": 2,
2521 "version_minor": 0,
2522 "model_id": "3a9c42437ab34710a3fd3a75cf9cfac4"
2523 }
2524 },
2525 "metadata": {}
2526 },
2527 {
2528 "output_type": "stream",
2529 "name": "stdout",
2530 "text": [
2531 "Epoch 13: val loss = 0.6666661500930786 val acc = 0.5333333611488342\n"
2532 ]
2533 },
2534 {
2535 "output_type": "display_data",
2536 "data": {
2537 "text/plain": [
2538 "Validation: 0it [00:00, ?it/s]"
2539 ],
2540 "application/vnd.jupyter.widget-view+json": {
2541 "version_major": 2,
2542 "version_minor": 0,
2543 "model_id": "71643356b8954af5ab6cdf03df2825e3"
2544 }
2545 },
2546 "metadata": {}
2547 },
2548 {
2549 "output_type": "stream",
2550 "name": "stdout",
2551 "text": [
2552 "Epoch 14: val loss = 0.663104772567749 val acc = 0.6000000238418579\n"
2553 ]
2554 },
2555 {
2556 "output_type": "display_data",
2557 "data": {
2558 "text/plain": [
2559 "Validation: 0it [00:00, ?it/s]"
2560 ],
2561 "application/vnd.jupyter.widget-view+json": {
2562 "version_major": 2,
2563 "version_minor": 0,
2564 "model_id": "a76a4846aa11422785c1d0218c94b827"
2565 }
2566 },
2567 "metadata": {}
2568 },
2569 {
2570 "output_type": "stream",
2571 "name": "stdout",
2572 "text": [
2573 "Epoch 15: val loss = 0.6596227884292603 val acc = 0.6000000238418579\n"
2574 ]
2575 },
2576 {
2577 "output_type": "display_data",
2578 "data": {
2579 "text/plain": [
2580 "Validation: 0it [00:00, ?it/s]"
2581 ],
2582 "application/vnd.jupyter.widget-view+json": {
2583 "version_major": 2,
2584 "version_minor": 0,
2585 "model_id": "67e1192ed6774aa9bb17f1d5a27695f9"
2586 }
2587 },
2588 "metadata": {}
2589 },
2590 {
2591 "output_type": "stream",
2592 "name": "stdout",
2593 "text": [
2594 "Epoch 16: val loss = 0.6562108993530273 val acc = 0.6000000238418579\n"
2595 ]
2596 },
2597 {
2598 "output_type": "display_data",
2599 "data": {
2600 "text/plain": [
2601 "Validation: 0it [00:00, ?it/s]"
2602 ],
2603 "application/vnd.jupyter.widget-view+json": {
2604 "version_major": 2,
2605 "version_minor": 0,
2606 "model_id": "6adb0fc2977b41e7bce4e81909c6c931"
2607 }
2608 },
2609 "metadata": {}
2610 },
2611 {
2612 "output_type": "stream",
2613 "name": "stdout",
2614 "text": [
2615 "Epoch 17: val loss = 0.652866542339325 val acc = 0.6666666865348816\n"
2616 ]
2617 },
2618 {
2619 "output_type": "display_data",
2620 "data": {
2621 "text/plain": [
2622 "Validation: 0it [00:00, ?it/s]"
2623 ],
2624 "application/vnd.jupyter.widget-view+json": {
2625 "version_major": 2,
2626 "version_minor": 0,
2627 "model_id": "f2fb2d0dfed54272abbc0560a467c97e"
2628 }
2629 },
2630 "metadata": {}
2631 },
2632 {
2633 "output_type": "stream",
2634 "name": "stdout",
2635 "text": [
2636 "Epoch 18: val loss = 0.649587094783783 val acc = 0.6666666865348816\n"
2637 ]
2638 },
2639 {
2640 "output_type": "display_data",
2641 "data": {
2642 "text/plain": [
2643 "Validation: 0it [00:00, ?it/s]"
2644 ],
2645 "application/vnd.jupyter.widget-view+json": {
2646 "version_major": 2,
2647 "version_minor": 0,
2648 "model_id": "02bda666a850468086acea36156397c7"
2649 }
2650 },
2651 "metadata": {}
2652 },
2653 {
2654 "output_type": "stream",
2655 "name": "stdout",
2656 "text": [
2657 "Epoch 19: val loss = 0.6463660597801208 val acc = 0.7333333492279053\n"
2658 ]
2659 },
2660 {
2661 "output_type": "display_data",
2662 "data": {
2663 "text/plain": [
2664 "Validation: 0it [00:00, ?it/s]"
2665 ],
2666 "application/vnd.jupyter.widget-view+json": {
2667 "version_major": 2,
2668 "version_minor": 0,
2669 "model_id": "0de2ddf45f754c5991a62ae8e822c4b7"
2670 }
2671 },
2672 "metadata": {}
2673 },
2674 {
2675 "output_type": "stream",
2676 "name": "stdout",
2677 "text": [
2678 "Epoch 20: val loss = 0.6432054042816162 val acc = 0.7333333492279053\n"
2679 ]
2680 },
2681 {
2682 "output_type": "display_data",
2683 "data": {
2684 "text/plain": [
2685 "Validation: 0it [00:00, ?it/s]"
2686 ],
2687 "application/vnd.jupyter.widget-view+json": {
2688 "version_major": 2,
2689 "version_minor": 0,
2690 "model_id": "814e2827e8d647069f05c5b4c89deb52"
2691 }
2692 },
2693 "metadata": {}
2694 },
2695 {
2696 "output_type": "stream",
2697 "name": "stdout",
2698 "text": [
2699 "Epoch 21: val loss = 0.6401029229164124 val acc = 0.7333333492279053\n"
2700 ]
2701 },
2702 {
2703 "output_type": "display_data",
2704 "data": {
2705 "text/plain": [
2706 "Validation: 0it [00:00, ?it/s]"
2707 ],
2708 "application/vnd.jupyter.widget-view+json": {
2709 "version_major": 2,
2710 "version_minor": 0,
2711 "model_id": "b38c3345647c4db68a2321e3a4d9e215"
2712 }
2713 },
2714 "metadata": {}
2715 },
2716 {
2717 "output_type": "stream",
2718 "name": "stdout",
2719 "text": [
2720 "Epoch 22: val loss = 0.6370567679405212 val acc = 0.7333333492279053\n"
2721 ]
2722 },
2723 {
2724 "output_type": "display_data",
2725 "data": {
2726 "text/plain": [
2727 "Validation: 0it [00:00, ?it/s]"
2728 ],
2729 "application/vnd.jupyter.widget-view+json": {
2730 "version_major": 2,
2731 "version_minor": 0,
2732 "model_id": "6daac3cee4b9409cba48efa0d06bee24"
2733 }
2734 },
2735 "metadata": {}
2736 },
2737 {
2738 "output_type": "stream",
2739 "name": "stdout",
2740 "text": [
2741 "Epoch 23: val loss = 0.6340654492378235 val acc = 0.7333333492279053\n"
2742 ]
2743 },
2744 {
2745 "output_type": "display_data",
2746 "data": {
2747 "text/plain": [
2748 "Validation: 0it [00:00, ?it/s]"
2749 ],
2750 "application/vnd.jupyter.widget-view+json": {
2751 "version_major": 2,
2752 "version_minor": 0,
2753 "model_id": "d4b061b8a44646a8b4ccc4839fe769a8"
2754 }
2755 },
2756 "metadata": {}
2757 },
2758 {
2759 "output_type": "stream",
2760 "name": "stdout",
2761 "text": [
2762 "Epoch 24: val loss = 0.6311267018318176 val acc = 0.7333333492279053\n"
2763 ]
2764 },
2765 {
2766 "output_type": "display_data",
2767 "data": {
2768 "text/plain": [
2769 "Validation: 0it [00:00, ?it/s]"
2770 ],
2771 "application/vnd.jupyter.widget-view+json": {
2772 "version_major": 2,
2773 "version_minor": 0,
2774 "model_id": "ac7a77f2fd1b4cdaab3ae8ff2bb8b963"
2775 }
2776 },
2777 "metadata": {}
2778 },
2779 {
2780 "output_type": "stream",
2781 "name": "stdout",
2782 "text": [
2783 "Epoch 25: val loss = 0.6282366514205933 val acc = 0.7333333492279053\n"
2784 ]
2785 },
2786 {
2787 "output_type": "display_data",
2788 "data": {
2789 "text/plain": [
2790 "Validation: 0it [00:00, ?it/s]"
2791 ],
2792 "application/vnd.jupyter.widget-view+json": {
2793 "version_major": 2,
2794 "version_minor": 0,
2795 "model_id": "8a006c7b0f0d431c8c024aad2ea8e427"
2796 }
2797 },
2798 "metadata": {}
2799 },
2800 {
2801 "output_type": "stream",
2802 "name": "stdout",
2803 "text": [
2804 "Epoch 26: val loss = 0.6253498792648315 val acc = 0.7333333492279053\n"
2805 ]
2806 },
2807 {
2808 "output_type": "display_data",
2809 "data": {
2810 "text/plain": [
2811 "Validation: 0it [00:00, ?it/s]"
2812 ],
2813 "application/vnd.jupyter.widget-view+json": {
2814 "version_major": 2,
2815 "version_minor": 0,
2816 "model_id": "a866149ec74144b385f55fdf7eb105a8"
2817 }
2818 },
2819 "metadata": {}
2820 },
2821 {
2822 "output_type": "stream",
2823 "name": "stdout",
2824 "text": [
2825 "Epoch 27: val loss = 0.6225143671035767 val acc = 0.7333333492279053\n"
2826 ]
2827 },
2828 {
2829 "output_type": "display_data",
2830 "data": {
2831 "text/plain": [
2832 "Validation: 0it [00:00, ?it/s]"
2833 ],
2834 "application/vnd.jupyter.widget-view+json": {
2835 "version_major": 2,
2836 "version_minor": 0,
2837 "model_id": "db881594d4b9483bab4d09b536a6602a"
2838 }
2839 },
2840 "metadata": {}
2841 },
2842 {
2843 "output_type": "stream",
2844 "name": "stdout",
2845 "text": [
2846 "Epoch 28: val loss = 0.6197248101234436 val acc = 0.7333333492279053\n"
2847 ]
2848 },
2849 {
2850 "output_type": "display_data",
2851 "data": {
2852 "text/plain": [
2853 "Validation: 0it [00:00, ?it/s]"
2854 ],
2855 "application/vnd.jupyter.widget-view+json": {
2856 "version_major": 2,
2857 "version_minor": 0,
2858 "model_id": "d89e128b65424ced9d2ea19e42facb67"
2859 }
2860 },
2861 "metadata": {}
2862 },
2863 {
2864 "output_type": "stream",
2865 "name": "stdout",
2866 "text": [
2867 "Epoch 29: val loss = 0.6169812679290771 val acc = 0.7333333492279053\n"
2868 ]
2869 },
2870 {
2871 "output_type": "display_data",
2872 "data": {
2873 "text/plain": [
2874 "Validation: 0it [00:00, ?it/s]"
2875 ],
2876 "application/vnd.jupyter.widget-view+json": {
2877 "version_major": 2,
2878 "version_minor": 0,
2879 "model_id": "40eaa223a6ef48628829d45f576c5293"
2880 }
2881 },
2882 "metadata": {}
2883 },
2884 {
2885 "output_type": "stream",
2886 "name": "stdout",
2887 "text": [
2888 "Epoch 30: val loss = 0.6142613887786865 val acc = 0.8000000715255737\n"
2889 ]
2890 }
2891 ]
2892 },
2893 {
2894 "cell_type": "markdown",
2895 "metadata": {
2896 "id": "iC7doHoWToPg"
2897 },
2898 "source": [
2899 "## Takeaways\n",
2900 "\n",
2901 "* PyTorch allows you to operate on tensors at low level, you have most flexibility.\n",
2902 "* There are convenient tools to work with data, such as Datasets and Dataloaders.\n",
2903 "* You can define neural network architectures using `Sequential` syntax, or inheriting a class from `torch.nn.Module`\n",
2904 "* For even simpler approach to defining and training a network - look into PyTorch Lightning"
2905 ]
2906 }
2907 ],
2908 "metadata": {
2909 "accelerator": "GPU",
2910 "celltoolbar": "Slideshow",
2911 "colab": {
2912 "collapsed_sections": [],
2913 "name": "IntroPyTorch.ipynb",
2914 "provenance": []
2915 },
2916 "interpreter": {
2917 "hash": "0cb620c6d4b9f7a635928804c26cf22403d89d98d79684e4529119355ee6d5a5"
2918 },
2919 "kernelspec": {
2920 "display_name": "Python 3.8.12 64-bit (conda)",
2921 "name": "python3"
2922 },
2923 "language_info": {
2924 "codemirror_mode": {
2925 "name": "ipython",
2926 "version": 3
2927 },
2928 "file_extension": ".py",
2929 "mimetype": "text/x-python",
2930 "name": "python",
2931 "nbconvert_exporter": "python",
2932 "pygments_lexer": "ipython3",
2933 "version": "3.8.12"
2934 },
2935 "livereveal": {
2936 "start_slideshow_at": "selected"
2937 },
2938 "widgets": {
2939 "application/vnd.jupyter.widget-state+json": {
2940 "1657a223e5524ca682ea081b9e4addea": {
2941 "model_module": "@jupyter-widgets/controls",
2942 "model_name": "HBoxModel",
2943 "model_module_version": "1.5.0",
2944 "state": {
2945 "_dom_classes": [],
2946 "_model_module": "@jupyter-widgets/controls",
2947 "_model_module_version": "1.5.0",
2948 "_model_name": "HBoxModel",
2949 "_view_count": null,
2950 "_view_module": "@jupyter-widgets/controls",
2951 "_view_module_version": "1.5.0",
2952 "_view_name": "HBoxView",
2953 "box_style": "",
2954 "children": [
2955 "IPY_MODEL_4f111fbdbc3440f783adc3df3df46494",
2956 "IPY_MODEL_cc048e2c91ce48258934ef577cf229d1",
2957 "IPY_MODEL_d3c01678943341c5b814430145692a69"
2958 ],
2959 "layout": "IPY_MODEL_9b55455cc9b541ef9634be2d790bb831"
2960 }
2961 },
2962 "4f111fbdbc3440f783adc3df3df46494": {
2963 "model_module": "@jupyter-widgets/controls",
2964 "model_name": "HTMLModel",
2965 "model_module_version": "1.5.0",
2966 "state": {
2967 "_dom_classes": [],
2968 "_model_module": "@jupyter-widgets/controls",
2969 "_model_module_version": "1.5.0",
2970 "_model_name": "HTMLModel",
2971 "_view_count": null,
2972 "_view_module": "@jupyter-widgets/controls",
2973 "_view_module_version": "1.5.0",
2974 "_view_name": "HTMLView",
2975 "description": "",
2976 "description_tooltip": null,
2977 "layout": "IPY_MODEL_15d7c09876074047afac1e41cb9ac121",
2978 "placeholder": "​",
2979 "style": "IPY_MODEL_90137ba0ff814f71ad964f45d704ee89",
2980 "value": "Sanity Checking DataLoader 0: 100%"
2981 }
2982 },
2983 "cc048e2c91ce48258934ef577cf229d1": {
2984 "model_module": "@jupyter-widgets/controls",
2985 "model_name": "FloatProgressModel",
2986 "model_module_version": "1.5.0",
2987 "state": {
2988 "_dom_classes": [],
2989 "_model_module": "@jupyter-widgets/controls",
2990 "_model_module_version": "1.5.0",
2991 "_model_name": "FloatProgressModel",
2992 "_view_count": null,
2993 "_view_module": "@jupyter-widgets/controls",
2994 "_view_module_version": "1.5.0",
2995 "_view_name": "ProgressView",
2996 "bar_style": "",
2997 "description": "",
2998 "description_tooltip": null,
2999 "layout": "IPY_MODEL_0919c9545ef64ed1a65f3f489d51cccc",
3000 "max": 1,
3001 "min": 0,
3002 "orientation": "horizontal",
3003 "style": "IPY_MODEL_12cad77b8027415b82937ad33f793a63",
3004 "value": 1
3005 }
3006 },
3007 "d3c01678943341c5b814430145692a69": {
3008 "model_module": "@jupyter-widgets/controls",
3009 "model_name": "HTMLModel",
3010 "model_module_version": "1.5.0",
3011 "state": {
3012 "_dom_classes": [],
3013 "_model_module": "@jupyter-widgets/controls",
3014 "_model_module_version": "1.5.0",
3015 "_model_name": "HTMLModel",
3016 "_view_count": null,
3017 "_view_module": "@jupyter-widgets/controls",
3018 "_view_module_version": "1.5.0",
3019 "_view_name": "HTMLView",
3020 "description": "",
3021 "description_tooltip": null,
3022 "layout": "IPY_MODEL_25ff491870eb4bf6ad4a320e5c99bd31",
3023 "placeholder": "​",
3024 "style": "IPY_MODEL_238a42e032c34b9183e1e6a75f886da0",
3025 "value": " 1/1 [00:00&lt;00:00, 273.19it/s]"
3026 }
3027 },
3028 "9b55455cc9b541ef9634be2d790bb831": {
3029 "model_module": "@jupyter-widgets/base",
3030 "model_name": "LayoutModel",
3031 "model_module_version": "1.2.0",
3032 "state": {
3033 "_model_module": "@jupyter-widgets/base",
3034 "_model_module_version": "1.2.0",
3035 "_model_name": "LayoutModel",
3036 "_view_count": null,
3037 "_view_module": "@jupyter-widgets/base",
3038 "_view_module_version": "1.2.0",
3039 "_view_name": "LayoutView",
3040 "align_content": null,
3041 "align_items": null,
3042 "align_self": null,
3043 "border": null,
3044 "bottom": null,
3045 "display": "inline-flex",
3046 "flex": null,
3047 "flex_flow": "row wrap",
3048 "grid_area": null,
3049 "grid_auto_columns": null,
3050 "grid_auto_flow": null,
3051 "grid_auto_rows": null,
3052 "grid_column": null,
3053 "grid_gap": null,
3054 "grid_row": null,
3055 "grid_template_areas": null,
3056 "grid_template_columns": null,
3057 "grid_template_rows": null,
3058 "height": null,
3059 "justify_content": null,
3060 "justify_items": null,
3061 "left": null,
3062 "margin": null,
3063 "max_height": null,
3064 "max_width": null,
3065 "min_height": null,
3066 "min_width": null,
3067 "object_fit": null,
3068 "object_position": null,
3069 "order": null,
3070 "overflow": null,
3071 "overflow_x": null,
3072 "overflow_y": null,
3073 "padding": null,
3074 "right": null,
3075 "top": null,
3076 "visibility": null,
3077 "width": "100%"
3078 }
3079 },
3080 "15d7c09876074047afac1e41cb9ac121": {
3081 "model_module": "@jupyter-widgets/base",
3082 "model_name": "LayoutModel",
3083 "model_module_version": "1.2.0",
3084 "state": {
3085 "_model_module": "@jupyter-widgets/base",
3086 "_model_module_version": "1.2.0",
3087 "_model_name": "LayoutModel",
3088 "_view_count": null,
3089 "_view_module": "@jupyter-widgets/base",
3090 "_view_module_version": "1.2.0",
3091 "_view_name": "LayoutView",
3092 "align_content": null,
3093 "align_items": null,
3094 "align_self": null,
3095 "border": null,
3096 "bottom": null,
3097 "display": null,
3098 "flex": null,
3099 "flex_flow": null,
3100 "grid_area": null,
3101 "grid_auto_columns": null,
3102 "grid_auto_flow": null,
3103 "grid_auto_rows": null,
3104 "grid_column": null,
3105 "grid_gap": null,
3106 "grid_row": null,
3107 "grid_template_areas": null,
3108 "grid_template_columns": null,
3109 "grid_template_rows": null,
3110 "height": null,
3111 "justify_content": null,
3112 "justify_items": null,
3113 "left": null,
3114 "margin": null,
3115 "max_height": null,
3116 "max_width": null,
3117 "min_height": null,
3118 "min_width": null,
3119 "object_fit": null,
3120 "object_position": null,
3121 "order": null,
3122 "overflow": null,
3123 "overflow_x": null,
3124 "overflow_y": null,
3125 "padding": null,
3126 "right": null,
3127 "top": null,
3128 "visibility": null,
3129 "width": null
3130 }
3131 },
3132 "90137ba0ff814f71ad964f45d704ee89": {
3133 "model_module": "@jupyter-widgets/controls",
3134 "model_name": "DescriptionStyleModel",
3135 "model_module_version": "1.5.0",
3136 "state": {
3137 "_model_module": "@jupyter-widgets/controls",
3138 "_model_module_version": "1.5.0",
3139 "_model_name": "DescriptionStyleModel",
3140 "_view_count": null,
3141 "_view_module": "@jupyter-widgets/base",
3142 "_view_module_version": "1.2.0",
3143 "_view_name": "StyleView",
3144 "description_width": ""
3145 }
3146 },
3147 "0919c9545ef64ed1a65f3f489d51cccc": {
3148 "model_module": "@jupyter-widgets/base",
3149 "model_name": "LayoutModel",
3150 "model_module_version": "1.2.0",
3151 "state": {
3152 "_model_module": "@jupyter-widgets/base",
3153 "_model_module_version": "1.2.0",
3154 "_model_name": "LayoutModel",
3155 "_view_count": null,
3156 "_view_module": "@jupyter-widgets/base",
3157 "_view_module_version": "1.2.0",
3158 "_view_name": "LayoutView",
3159 "align_content": null,
3160 "align_items": null,
3161 "align_self": null,
3162 "border": null,
3163 "bottom": null,
3164 "display": null,
3165 "flex": "2",
3166 "flex_flow": null,
3167 "grid_area": null,
3168 "grid_auto_columns": null,
3169 "grid_auto_flow": null,
3170 "grid_auto_rows": null,
3171 "grid_column": null,
3172 "grid_gap": null,
3173 "grid_row": null,
3174 "grid_template_areas": null,
3175 "grid_template_columns": null,
3176 "grid_template_rows": null,
3177 "height": null,
3178 "justify_content": null,
3179 "justify_items": null,
3180 "left": null,
3181 "margin": null,
3182 "max_height": null,
3183 "max_width": null,
3184 "min_height": null,
3185 "min_width": null,
3186 "object_fit": null,
3187 "object_position": null,
3188 "order": null,
3189 "overflow": null,
3190 "overflow_x": null,
3191 "overflow_y": null,
3192 "padding": null,
3193 "right": null,
3194 "top": null,
3195 "visibility": null,
3196 "width": null
3197 }
3198 },
3199 "12cad77b8027415b82937ad33f793a63": {
3200 "model_module": "@jupyter-widgets/controls",
3201 "model_name": "ProgressStyleModel",
3202 "model_module_version": "1.5.0",
3203 "state": {
3204 "_model_module": "@jupyter-widgets/controls",
3205 "_model_module_version": "1.5.0",
3206 "_model_name": "ProgressStyleModel",
3207 "_view_count": null,
3208 "_view_module": "@jupyter-widgets/base",
3209 "_view_module_version": "1.2.0",
3210 "_view_name": "StyleView",
3211 "bar_color": null,
3212 "description_width": ""
3213 }
3214 },
3215 "25ff491870eb4bf6ad4a320e5c99bd31": {
3216 "model_module": "@jupyter-widgets/base",
3217 "model_name": "LayoutModel",
3218 "model_module_version": "1.2.0",
3219 "state": {
3220 "_model_module": "@jupyter-widgets/base",
3221 "_model_module_version": "1.2.0",
3222 "_model_name": "LayoutModel",
3223 "_view_count": null,
3224 "_view_module": "@jupyter-widgets/base",
3225 "_view_module_version": "1.2.0",
3226 "_view_name": "LayoutView",
3227 "align_content": null,
3228 "align_items": null,
3229 "align_self": null,
3230 "border": null,
3231 "bottom": null,
3232 "display": null,
3233 "flex": null,
3234 "flex_flow": null,
3235 "grid_area": null,
3236 "grid_auto_columns": null,
3237 "grid_auto_flow": null,
3238 "grid_auto_rows": null,
3239 "grid_column": null,
3240 "grid_gap": null,
3241 "grid_row": null,
3242 "grid_template_areas": null,
3243 "grid_template_columns": null,
3244 "grid_template_rows": null,
3245 "height": null,
3246 "justify_content": null,
3247 "justify_items": null,
3248 "left": null,
3249 "margin": null,
3250 "max_height": null,
3251 "max_width": null,
3252 "min_height": null,
3253 "min_width": null,
3254 "object_fit": null,
3255 "object_position": null,
3256 "order": null,
3257 "overflow": null,
3258 "overflow_x": null,
3259 "overflow_y": null,
3260 "padding": null,
3261 "right": null,
3262 "top": null,
3263 "visibility": null,
3264 "width": null
3265 }
3266 },
3267 "238a42e032c34b9183e1e6a75f886da0": {
3268 "model_module": "@jupyter-widgets/controls",
3269 "model_name": "DescriptionStyleModel",
3270 "model_module_version": "1.5.0",
3271 "state": {
3272 "_model_module": "@jupyter-widgets/controls",
3273 "_model_module_version": "1.5.0",
3274 "_model_name": "DescriptionStyleModel",
3275 "_view_count": null,
3276 "_view_module": "@jupyter-widgets/base",
3277 "_view_module_version": "1.2.0",
3278 "_view_name": "StyleView",
3279 "description_width": ""
3280 }
3281 },
3282 "a4fb1b2e0f8b4346bbde1b949dbce0fd": {
3283 "model_module": "@jupyter-widgets/controls",
3284 "model_name": "HBoxModel",
3285 "model_module_version": "1.5.0",
3286 "state": {
3287 "_dom_classes": [],
3288 "_model_module": "@jupyter-widgets/controls",
3289 "_model_module_version": "1.5.0",
3290 "_model_name": "HBoxModel",
3291 "_view_count": null,
3292 "_view_module": "@jupyter-widgets/controls",
3293 "_view_module_version": "1.5.0",
3294 "_view_name": "HBoxView",
3295 "box_style": "",
3296 "children": [
3297 "IPY_MODEL_18876b0e4f0f4b21ad1802f36637c067",
3298 "IPY_MODEL_92ef8d6e24604b2f895e3876dc9996ee",
3299 "IPY_MODEL_d4bc1057a59c4666a7dc0f9627c45901"
3300 ],
3301 "layout": "IPY_MODEL_3355e659c40e4e42bbad6c8690f5055e"
3302 }
3303 },
3304 "18876b0e4f0f4b21ad1802f36637c067": {
3305 "model_module": "@jupyter-widgets/controls",
3306 "model_name": "HTMLModel",
3307 "model_module_version": "1.5.0",
3308 "state": {
3309 "_dom_classes": [],
3310 "_model_module": "@jupyter-widgets/controls",
3311 "_model_module_version": "1.5.0",
3312 "_model_name": "HTMLModel",
3313 "_view_count": null,
3314 "_view_module": "@jupyter-widgets/controls",
3315 "_view_module_version": "1.5.0",
3316 "_view_name": "HTMLView",
3317 "description": "",
3318 "description_tooltip": null,
3319 "layout": "IPY_MODEL_0ab539031d80478685164ce470246d57",
3320 "placeholder": "​",
3321 "style": "IPY_MODEL_271fdffaef854a67b294c0ccdfb6fe91",
3322 "value": "Epoch 29: 100%"
3323 }
3324 },
3325 "92ef8d6e24604b2f895e3876dc9996ee": {
3326 "model_module": "@jupyter-widgets/controls",
3327 "model_name": "FloatProgressModel",
3328 "model_module_version": "1.5.0",
3329 "state": {
3330 "_dom_classes": [],
3331 "_model_module": "@jupyter-widgets/controls",
3332 "_model_module_version": "1.5.0",
3333 "_model_name": "FloatProgressModel",
3334 "_view_count": null,
3335 "_view_module": "@jupyter-widgets/controls",
3336 "_view_module_version": "1.5.0",
3337 "_view_name": "ProgressView",
3338 "bar_style": "success",
3339 "description": "",
3340 "description_tooltip": null,
3341 "layout": "IPY_MODEL_0bd01bf4a9954fe2ba2760d10b9d7971",
3342 "max": 6,
3343 "min": 0,
3344 "orientation": "horizontal",
3345 "style": "IPY_MODEL_bd5250b6001c4cd282a25d498ee4e673",
3346 "value": 6
3347 }
3348 },
3349 "d4bc1057a59c4666a7dc0f9627c45901": {
3350 "model_module": "@jupyter-widgets/controls",
3351 "model_name": "HTMLModel",
3352 "model_module_version": "1.5.0",
3353 "state": {
3354 "_dom_classes": [],
3355 "_model_module": "@jupyter-widgets/controls",
3356 "_model_module_version": "1.5.0",
3357 "_model_name": "HTMLModel",
3358 "_view_count": null,
3359 "_view_module": "@jupyter-widgets/controls",
3360 "_view_module_version": "1.5.0",
3361 "_view_name": "HTMLView",
3362 "description": "",
3363 "description_tooltip": null,
3364 "layout": "IPY_MODEL_21538a0928e04ca08562dda0322385a1",
3365 "placeholder": "​",
3366 "style": "IPY_MODEL_5301b071e422430e9bff6cd23c2853b5",
3367 "value": " 6/6 [00:00&lt;00:00, 44.67it/s, loss=0.597, v_num=18]"
3368 }
3369 },
3370 "3355e659c40e4e42bbad6c8690f5055e": {
3371 "model_module": "@jupyter-widgets/base",
3372 "model_name": "LayoutModel",
3373 "model_module_version": "1.2.0",
3374 "state": {
3375 "_model_module": "@jupyter-widgets/base",
3376 "_model_module_version": "1.2.0",
3377 "_model_name": "LayoutModel",
3378 "_view_count": null,
3379 "_view_module": "@jupyter-widgets/base",
3380 "_view_module_version": "1.2.0",
3381 "_view_name": "LayoutView",
3382 "align_content": null,
3383 "align_items": null,
3384 "align_self": null,
3385 "border": null,
3386 "bottom": null,
3387 "display": "inline-flex",
3388 "flex": null,
3389 "flex_flow": "row wrap",
3390 "grid_area": null,
3391 "grid_auto_columns": null,
3392 "grid_auto_flow": null,
3393 "grid_auto_rows": null,
3394 "grid_column": null,
3395 "grid_gap": null,
3396 "grid_row": null,
3397 "grid_template_areas": null,
3398 "grid_template_columns": null,
3399 "grid_template_rows": null,
3400 "height": null,
3401 "justify_content": null,
3402 "justify_items": null,
3403 "left": null,
3404 "margin": null,
3405 "max_height": null,
3406 "max_width": null,
3407 "min_height": null,
3408 "min_width": null,
3409 "object_fit": null,
3410 "object_position": null,
3411 "order": null,
3412 "overflow": null,
3413 "overflow_x": null,
3414 "overflow_y": null,
3415 "padding": null,
3416 "right": null,
3417 "top": null,
3418 "visibility": null,
3419 "width": "100%"
3420 }
3421 },
3422 "0ab539031d80478685164ce470246d57": {
3423 "model_module": "@jupyter-widgets/base",
3424 "model_name": "LayoutModel",
3425 "model_module_version": "1.2.0",
3426 "state": {
3427 "_model_module": "@jupyter-widgets/base",
3428 "_model_module_version": "1.2.0",
3429 "_model_name": "LayoutModel",
3430 "_view_count": null,
3431 "_view_module": "@jupyter-widgets/base",
3432 "_view_module_version": "1.2.0",
3433 "_view_name": "LayoutView",
3434 "align_content": null,
3435 "align_items": null,
3436 "align_self": null,
3437 "border": null,
3438 "bottom": null,
3439 "display": null,
3440 "flex": null,
3441 "flex_flow": null,
3442 "grid_area": null,
3443 "grid_auto_columns": null,
3444 "grid_auto_flow": null,
3445 "grid_auto_rows": null,
3446 "grid_column": null,
3447 "grid_gap": null,
3448 "grid_row": null,
3449 "grid_template_areas": null,
3450 "grid_template_columns": null,
3451 "grid_template_rows": null,
3452 "height": null,
3453 "justify_content": null,
3454 "justify_items": null,
3455 "left": null,
3456 "margin": null,
3457 "max_height": null,
3458 "max_width": null,
3459 "min_height": null,
3460 "min_width": null,
3461 "object_fit": null,
3462 "object_position": null,
3463 "order": null,
3464 "overflow": null,
3465 "overflow_x": null,
3466 "overflow_y": null,
3467 "padding": null,
3468 "right": null,
3469 "top": null,
3470 "visibility": null,
3471 "width": null
3472 }
3473 },
3474 "271fdffaef854a67b294c0ccdfb6fe91": {
3475 "model_module": "@jupyter-widgets/controls",
3476 "model_name": "DescriptionStyleModel",
3477 "model_module_version": "1.5.0",
3478 "state": {
3479 "_model_module": "@jupyter-widgets/controls",
3480 "_model_module_version": "1.5.0",
3481 "_model_name": "DescriptionStyleModel",
3482 "_view_count": null,
3483 "_view_module": "@jupyter-widgets/base",
3484 "_view_module_version": "1.2.0",
3485 "_view_name": "StyleView",
3486 "description_width": ""
3487 }
3488 },
3489 "0bd01bf4a9954fe2ba2760d10b9d7971": {
3490 "model_module": "@jupyter-widgets/base",
3491 "model_name": "LayoutModel",
3492 "model_module_version": "1.2.0",
3493 "state": {
3494 "_model_module": "@jupyter-widgets/base",
3495 "_model_module_version": "1.2.0",
3496 "_model_name": "LayoutModel",
3497 "_view_count": null,
3498 "_view_module": "@jupyter-widgets/base",
3499 "_view_module_version": "1.2.0",
3500 "_view_name": "LayoutView",
3501 "align_content": null,
3502 "align_items": null,
3503 "align_self": null,
3504 "border": null,
3505 "bottom": null,
3506 "display": null,
3507 "flex": "2",
3508 "flex_flow": null,
3509 "grid_area": null,
3510 "grid_auto_columns": null,
3511 "grid_auto_flow": null,
3512 "grid_auto_rows": null,
3513 "grid_column": null,
3514 "grid_gap": null,
3515 "grid_row": null,
3516 "grid_template_areas": null,
3517 "grid_template_columns": null,
3518 "grid_template_rows": null,
3519 "height": null,
3520 "justify_content": null,
3521 "justify_items": null,
3522 "left": null,
3523 "margin": null,
3524 "max_height": null,
3525 "max_width": null,
3526 "min_height": null,
3527 "min_width": null,
3528 "object_fit": null,
3529 "object_position": null,
3530 "order": null,
3531 "overflow": null,
3532 "overflow_x": null,
3533 "overflow_y": null,
3534 "padding": null,
3535 "right": null,
3536 "top": null,
3537 "visibility": null,
3538 "width": null
3539 }
3540 },
3541 "bd5250b6001c4cd282a25d498ee4e673": {
3542 "model_module": "@jupyter-widgets/controls",
3543 "model_name": "ProgressStyleModel",
3544 "model_module_version": "1.5.0",
3545 "state": {
3546 "_model_module": "@jupyter-widgets/controls",
3547 "_model_module_version": "1.5.0",
3548 "_model_name": "ProgressStyleModel",
3549 "_view_count": null,
3550 "_view_module": "@jupyter-widgets/base",
3551 "_view_module_version": "1.2.0",
3552 "_view_name": "StyleView",
3553 "bar_color": null,
3554 "description_width": ""
3555 }
3556 },
3557 "21538a0928e04ca08562dda0322385a1": {
3558 "model_module": "@jupyter-widgets/base",
3559 "model_name": "LayoutModel",
3560 "model_module_version": "1.2.0",
3561 "state": {
3562 "_model_module": "@jupyter-widgets/base",
3563 "_model_module_version": "1.2.0",
3564 "_model_name": "LayoutModel",
3565 "_view_count": null,
3566 "_view_module": "@jupyter-widgets/base",
3567 "_view_module_version": "1.2.0",
3568 "_view_name": "LayoutView",
3569 "align_content": null,
3570 "align_items": null,
3571 "align_self": null,
3572 "border": null,
3573 "bottom": null,
3574 "display": null,
3575 "flex": null,
3576 "flex_flow": null,
3577 "grid_area": null,
3578 "grid_auto_columns": null,
3579 "grid_auto_flow": null,
3580 "grid_auto_rows": null,
3581 "grid_column": null,
3582 "grid_gap": null,
3583 "grid_row": null,
3584 "grid_template_areas": null,
3585 "grid_template_columns": null,
3586 "grid_template_rows": null,
3587 "height": null,
3588 "justify_content": null,
3589 "justify_items": null,
3590 "left": null,
3591 "margin": null,
3592 "max_height": null,
3593 "max_width": null,
3594 "min_height": null,
3595 "min_width": null,
3596 "object_fit": null,
3597 "object_position": null,
3598 "order": null,
3599 "overflow": null,
3600 "overflow_x": null,
3601 "overflow_y": null,
3602 "padding": null,
3603 "right": null,
3604 "top": null,
3605 "visibility": null,
3606 "width": null
3607 }
3608 },
3609 "5301b071e422430e9bff6cd23c2853b5": {
3610 "model_module": "@jupyter-widgets/controls",
3611 "model_name": "DescriptionStyleModel",
3612 "model_module_version": "1.5.0",
3613 "state": {
3614 "_model_module": "@jupyter-widgets/controls",
3615 "_model_module_version": "1.5.0",
3616 "_model_name": "DescriptionStyleModel",
3617 "_view_count": null,
3618 "_view_module": "@jupyter-widgets/base",
3619 "_view_module_version": "1.2.0",
3620 "_view_name": "StyleView",
3621 "description_width": ""
3622 }
3623 },
3624 "3e63509c89304bccb2c7371ec5e7ca62": {
3625 "model_module": "@jupyter-widgets/controls",
3626 "model_name": "HBoxModel",
3627 "model_module_version": "1.5.0",
3628 "state": {
3629 "_dom_classes": [],
3630 "_model_module": "@jupyter-widgets/controls",
3631 "_model_module_version": "1.5.0",
3632 "_model_name": "HBoxModel",
3633 "_view_count": null,
3634 "_view_module": "@jupyter-widgets/controls",
3635 "_view_module_version": "1.5.0",
3636 "_view_name": "HBoxView",
3637 "box_style": "",
3638 "children": [
3639 "IPY_MODEL_ff10f2e47185425eaa1229be76092ee5",
3640 "IPY_MODEL_03cbfa5d29d548498035ba7bf7e0b659",
3641 "IPY_MODEL_561c5a5b02894df2a66b2991877e1231"
3642 ],
3643 "layout": "IPY_MODEL_569851b1958f49e281770b65bf78b60a"
3644 }
3645 },
3646 "ff10f2e47185425eaa1229be76092ee5": {
3647 "model_module": "@jupyter-widgets/controls",
3648 "model_name": "HTMLModel",
3649 "model_module_version": "1.5.0",
3650 "state": {
3651 "_dom_classes": [],
3652 "_model_module": "@jupyter-widgets/controls",
3653 "_model_module_version": "1.5.0",
3654 "_model_name": "HTMLModel",
3655 "_view_count": null,
3656 "_view_module": "@jupyter-widgets/controls",
3657 "_view_module_version": "1.5.0",
3658 "_view_name": "HTMLView",
3659 "description": "",
3660 "description_tooltip": null,
3661 "layout": "IPY_MODEL_2b49a1491afb4946975395080b9117e9",
3662 "placeholder": "​",
3663 "style": "IPY_MODEL_79737a473e0b4b59bb4d6f190d92b94c",
3664 "value": "Validation DataLoader 0: 100%"
3665 }
3666 },
3667 "03cbfa5d29d548498035ba7bf7e0b659": {
3668 "model_module": "@jupyter-widgets/controls",
3669 "model_name": "FloatProgressModel",
3670 "model_module_version": "1.5.0",
3671 "state": {
3672 "_dom_classes": [],
3673 "_model_module": "@jupyter-widgets/controls",
3674 "_model_module_version": "1.5.0",
3675 "_model_name": "FloatProgressModel",
3676 "_view_count": null,
3677 "_view_module": "@jupyter-widgets/controls",
3678 "_view_module_version": "1.5.0",
3679 "_view_name": "ProgressView",
3680 "bar_style": "",
3681 "description": "",
3682 "description_tooltip": null,
3683 "layout": "IPY_MODEL_d8a3af0177fc4707b928629952396ad5",
3684 "max": 1,
3685 "min": 0,
3686 "orientation": "horizontal",
3687 "style": "IPY_MODEL_34852db50a91487795451f76b57da6b2",
3688 "value": 1
3689 }
3690 },
3691 "561c5a5b02894df2a66b2991877e1231": {
3692 "model_module": "@jupyter-widgets/controls",
3693 "model_name": "HTMLModel",
3694 "model_module_version": "1.5.0",
3695 "state": {
3696 "_dom_classes": [],
3697 "_model_module": "@jupyter-widgets/controls",
3698 "_model_module_version": "1.5.0",
3699 "_model_name": "HTMLModel",
3700 "_view_count": null,
3701 "_view_module": "@jupyter-widgets/controls",
3702 "_view_module_version": "1.5.0",
3703 "_view_name": "HTMLView",
3704 "description": "",
3705 "description_tooltip": null,
3706 "layout": "IPY_MODEL_046c75ea1598416497c2ef218d1f268a",
3707 "placeholder": "​",
3708 "style": "IPY_MODEL_16e49dd0c2094a87a398416bac89ef69",
3709 "value": " 1/1 [00:00&lt;00:00, 73.83it/s]"
3710 }
3711 },
3712 "569851b1958f49e281770b65bf78b60a": {
3713 "model_module": "@jupyter-widgets/base",
3714 "model_name": "LayoutModel",
3715 "model_module_version": "1.2.0",
3716 "state": {
3717 "_model_module": "@jupyter-widgets/base",
3718 "_model_module_version": "1.2.0",
3719 "_model_name": "LayoutModel",
3720 "_view_count": null,
3721 "_view_module": "@jupyter-widgets/base",
3722 "_view_module_version": "1.2.0",
3723 "_view_name": "LayoutView",
3724 "align_content": null,
3725 "align_items": null,
3726 "align_self": null,
3727 "border": null,
3728 "bottom": null,
3729 "display": "inline-flex",
3730 "flex": null,
3731 "flex_flow": "row wrap",
3732 "grid_area": null,
3733 "grid_auto_columns": null,
3734 "grid_auto_flow": null,
3735 "grid_auto_rows": null,
3736 "grid_column": null,
3737 "grid_gap": null,
3738 "grid_row": null,
3739 "grid_template_areas": null,
3740 "grid_template_columns": null,
3741 "grid_template_rows": null,
3742 "height": null,
3743 "justify_content": null,
3744 "justify_items": null,
3745 "left": null,
3746 "margin": null,
3747 "max_height": null,
3748 "max_width": null,
3749 "min_height": null,
3750 "min_width": null,
3751 "object_fit": null,
3752 "object_position": null,
3753 "order": null,
3754 "overflow": null,
3755 "overflow_x": null,
3756 "overflow_y": null,
3757 "padding": null,
3758 "right": null,
3759 "top": null,
3760 "visibility": null,
3761 "width": "100%"
3762 }
3763 },
3764 "2b49a1491afb4946975395080b9117e9": {
3765 "model_module": "@jupyter-widgets/base",
3766 "model_name": "LayoutModel",
3767 "model_module_version": "1.2.0",
3768 "state": {
3769 "_model_module": "@jupyter-widgets/base",
3770 "_model_module_version": "1.2.0",
3771 "_model_name": "LayoutModel",
3772 "_view_count": null,
3773 "_view_module": "@jupyter-widgets/base",
3774 "_view_module_version": "1.2.0",
3775 "_view_name": "LayoutView",
3776 "align_content": null,
3777 "align_items": null,
3778 "align_self": null,
3779 "border": null,
3780 "bottom": null,
3781 "display": null,
3782 "flex": null,
3783 "flex_flow": null,
3784 "grid_area": null,
3785 "grid_auto_columns": null,
3786 "grid_auto_flow": null,
3787 "grid_auto_rows": null,
3788 "grid_column": null,
3789 "grid_gap": null,
3790 "grid_row": null,
3791 "grid_template_areas": null,
3792 "grid_template_columns": null,
3793 "grid_template_rows": null,
3794 "height": null,
3795 "justify_content": null,
3796 "justify_items": null,
3797 "left": null,
3798 "margin": null,
3799 "max_height": null,
3800 "max_width": null,
3801 "min_height": null,
3802 "min_width": null,
3803 "object_fit": null,
3804 "object_position": null,
3805 "order": null,
3806 "overflow": null,
3807 "overflow_x": null,
3808 "overflow_y": null,
3809 "padding": null,
3810 "right": null,
3811 "top": null,
3812 "visibility": null,
3813 "width": null
3814 }
3815 },
3816 "79737a473e0b4b59bb4d6f190d92b94c": {
3817 "model_module": "@jupyter-widgets/controls",
3818 "model_name": "DescriptionStyleModel",
3819 "model_module_version": "1.5.0",
3820 "state": {
3821 "_model_module": "@jupyter-widgets/controls",
3822 "_model_module_version": "1.5.0",
3823 "_model_name": "DescriptionStyleModel",
3824 "_view_count": null,
3825 "_view_module": "@jupyter-widgets/base",
3826 "_view_module_version": "1.2.0",
3827 "_view_name": "StyleView",
3828 "description_width": ""
3829 }
3830 },
3831 "d8a3af0177fc4707b928629952396ad5": {
3832 "model_module": "@jupyter-widgets/base",
3833 "model_name": "LayoutModel",
3834 "model_module_version": "1.2.0",
3835 "state": {
3836 "_model_module": "@jupyter-widgets/base",
3837 "_model_module_version": "1.2.0",
3838 "_model_name": "LayoutModel",
3839 "_view_count": null,
3840 "_view_module": "@jupyter-widgets/base",
3841 "_view_module_version": "1.2.0",
3842 "_view_name": "LayoutView",
3843 "align_content": null,
3844 "align_items": null,
3845 "align_self": null,
3846 "border": null,
3847 "bottom": null,
3848 "display": null,
3849 "flex": "2",
3850 "flex_flow": null,
3851 "grid_area": null,
3852 "grid_auto_columns": null,
3853 "grid_auto_flow": null,
3854 "grid_auto_rows": null,
3855 "grid_column": null,
3856 "grid_gap": null,
3857 "grid_row": null,
3858 "grid_template_areas": null,
3859 "grid_template_columns": null,
3860 "grid_template_rows": null,
3861 "height": null,
3862 "justify_content": null,
3863 "justify_items": null,
3864 "left": null,
3865 "margin": null,
3866 "max_height": null,
3867 "max_width": null,
3868 "min_height": null,
3869 "min_width": null,
3870 "object_fit": null,
3871 "object_position": null,
3872 "order": null,
3873 "overflow": null,
3874 "overflow_x": null,
3875 "overflow_y": null,
3876 "padding": null,
3877 "right": null,
3878 "top": null,
3879 "visibility": null,
3880 "width": null
3881 }
3882 },
3883 "34852db50a91487795451f76b57da6b2": {
3884 "model_module": "@jupyter-widgets/controls",
3885 "model_name": "ProgressStyleModel",
3886 "model_module_version": "1.5.0",
3887 "state": {
3888 "_model_module": "@jupyter-widgets/controls",
3889 "_model_module_version": "1.5.0",
3890 "_model_name": "ProgressStyleModel",
3891 "_view_count": null,
3892 "_view_module": "@jupyter-widgets/base",
3893 "_view_module_version": "1.2.0",
3894 "_view_name": "StyleView",
3895 "bar_color": null,
3896 "description_width": ""
3897 }
3898 },
3899 "046c75ea1598416497c2ef218d1f268a": {
3900 "model_module": "@jupyter-widgets/base",
3901 "model_name": "LayoutModel",
3902 "model_module_version": "1.2.0",
3903 "state": {
3904 "_model_module": "@jupyter-widgets/base",
3905 "_model_module_version": "1.2.0",
3906 "_model_name": "LayoutModel",
3907 "_view_count": null,
3908 "_view_module": "@jupyter-widgets/base",
3909 "_view_module_version": "1.2.0",
3910 "_view_name": "LayoutView",
3911 "align_content": null,
3912 "align_items": null,
3913 "align_self": null,
3914 "border": null,
3915 "bottom": null,
3916 "display": null,
3917 "flex": null,
3918 "flex_flow": null,
3919 "grid_area": null,
3920 "grid_auto_columns": null,
3921 "grid_auto_flow": null,
3922 "grid_auto_rows": null,
3923 "grid_column": null,
3924 "grid_gap": null,
3925 "grid_row": null,
3926 "grid_template_areas": null,
3927 "grid_template_columns": null,
3928 "grid_template_rows": null,
3929 "height": null,
3930 "justify_content": null,
3931 "justify_items": null,
3932 "left": null,
3933 "margin": null,
3934 "max_height": null,
3935 "max_width": null,
3936 "min_height": null,
3937 "min_width": null,
3938 "object_fit": null,
3939 "object_position": null,
3940 "order": null,
3941 "overflow": null,
3942 "overflow_x": null,
3943 "overflow_y": null,
3944 "padding": null,
3945 "right": null,
3946 "top": null,
3947 "visibility": null,
3948 "width": null
3949 }
3950 },
3951 "16e49dd0c2094a87a398416bac89ef69": {
3952 "model_module": "@jupyter-widgets/controls",
3953 "model_name": "DescriptionStyleModel",
3954 "model_module_version": "1.5.0",
3955 "state": {
3956 "_model_module": "@jupyter-widgets/controls",
3957 "_model_module_version": "1.5.0",
3958 "_model_name": "DescriptionStyleModel",
3959 "_view_count": null,
3960 "_view_module": "@jupyter-widgets/base",
3961 "_view_module_version": "1.2.0",
3962 "_view_name": "StyleView",
3963 "description_width": ""
3964 }
3965 },
3966 "e6c4eb3c595c43ef9722654dcfabfcc6": {
3967 "model_module": "@jupyter-widgets/controls",
3968 "model_name": "HBoxModel",
3969 "model_module_version": "1.5.0",
3970 "state": {
3971 "_dom_classes": [],
3972 "_model_module": "@jupyter-widgets/controls",
3973 "_model_module_version": "1.5.0",
3974 "_model_name": "HBoxModel",
3975 "_view_count": null,
3976 "_view_module": "@jupyter-widgets/controls",
3977 "_view_module_version": "1.5.0",
3978 "_view_name": "HBoxView",
3979 "box_style": "",
3980 "children": [
3981 "IPY_MODEL_62f1b983740e47cd8664eccafc926e32",
3982 "IPY_MODEL_9861f59fd71a4e3c879858ef8b4b40fb",
3983 "IPY_MODEL_d9960d4519ec42bcb8678359b278c7b5"
3984 ],
3985 "layout": "IPY_MODEL_118e90e145994312897584085642c03b"
3986 }
3987 },
3988 "62f1b983740e47cd8664eccafc926e32": {
3989 "model_module": "@jupyter-widgets/controls",
3990 "model_name": "HTMLModel",
3991 "model_module_version": "1.5.0",
3992 "state": {
3993 "_dom_classes": [],
3994 "_model_module": "@jupyter-widgets/controls",
3995 "_model_module_version": "1.5.0",
3996 "_model_name": "HTMLModel",
3997 "_view_count": null,
3998 "_view_module": "@jupyter-widgets/controls",
3999 "_view_module_version": "1.5.0",
4000 "_view_name": "HTMLView",
4001 "description": "",
4002 "description_tooltip": null,
4003 "layout": "IPY_MODEL_db156fc5cbfd426e8460232b8f760733",
4004 "placeholder": "​",
4005 "style": "IPY_MODEL_e68df50870c5469a9dc86346d7ad9a4e",
4006 "value": "Validation DataLoader 0: 100%"
4007 }
4008 },
4009 "9861f59fd71a4e3c879858ef8b4b40fb": {
4010 "model_module": "@jupyter-widgets/controls",
4011 "model_name": "FloatProgressModel",
4012 "model_module_version": "1.5.0",
4013 "state": {
4014 "_dom_classes": [],
4015 "_model_module": "@jupyter-widgets/controls",
4016 "_model_module_version": "1.5.0",
4017 "_model_name": "FloatProgressModel",
4018 "_view_count": null,
4019 "_view_module": "@jupyter-widgets/controls",
4020 "_view_module_version": "1.5.0",
4021 "_view_name": "ProgressView",
4022 "bar_style": "",
4023 "description": "",
4024 "description_tooltip": null,
4025 "layout": "IPY_MODEL_c89c5ec1ca1549cbbc7dd57b3672d74e",
4026 "max": 1,
4027 "min": 0,
4028 "orientation": "horizontal",
4029 "style": "IPY_MODEL_84e423587f4244938844cd74d2f86dc0",
4030 "value": 1
4031 }
4032 },
4033 "d9960d4519ec42bcb8678359b278c7b5": {
4034 "model_module": "@jupyter-widgets/controls",
4035 "model_name": "HTMLModel",
4036 "model_module_version": "1.5.0",
4037 "state": {
4038 "_dom_classes": [],
4039 "_model_module": "@jupyter-widgets/controls",
4040 "_model_module_version": "1.5.0",
4041 "_model_name": "HTMLModel",
4042 "_view_count": null,
4043 "_view_module": "@jupyter-widgets/controls",
4044 "_view_module_version": "1.5.0",
4045 "_view_name": "HTMLView",
4046 "description": "",
4047 "description_tooltip": null,
4048 "layout": "IPY_MODEL_a31f6ff7fbc54df5bd1745816b2176f8",
4049 "placeholder": "​",
4050 "style": "IPY_MODEL_d6d02c0963c54a6bbbd6753f3c3e6503",
4051 "value": " 1/1 [00:00&lt;00:00, 97.96it/s]"
4052 }
4053 },
4054 "118e90e145994312897584085642c03b": {
4055 "model_module": "@jupyter-widgets/base",
4056 "model_name": "LayoutModel",
4057 "model_module_version": "1.2.0",
4058 "state": {
4059 "_model_module": "@jupyter-widgets/base",
4060 "_model_module_version": "1.2.0",
4061 "_model_name": "LayoutModel",
4062 "_view_count": null,
4063 "_view_module": "@jupyter-widgets/base",
4064 "_view_module_version": "1.2.0",
4065 "_view_name": "LayoutView",
4066 "align_content": null,
4067 "align_items": null,
4068 "align_self": null,
4069 "border": null,
4070 "bottom": null,
4071 "display": "inline-flex",
4072 "flex": null,
4073 "flex_flow": "row wrap",
4074 "grid_area": null,
4075 "grid_auto_columns": null,
4076 "grid_auto_flow": null,
4077 "grid_auto_rows": null,
4078 "grid_column": null,
4079 "grid_gap": null,
4080 "grid_row": null,
4081 "grid_template_areas": null,
4082 "grid_template_columns": null,
4083 "grid_template_rows": null,
4084 "height": null,
4085 "justify_content": null,
4086 "justify_items": null,
4087 "left": null,
4088 "margin": null,
4089 "max_height": null,
4090 "max_width": null,
4091 "min_height": null,
4092 "min_width": null,
4093 "object_fit": null,
4094 "object_position": null,
4095 "order": null,
4096 "overflow": null,
4097 "overflow_x": null,
4098 "overflow_y": null,
4099 "padding": null,
4100 "right": null,
4101 "top": null,
4102 "visibility": null,
4103 "width": "100%"
4104 }
4105 },
4106 "db156fc5cbfd426e8460232b8f760733": {
4107 "model_module": "@jupyter-widgets/base",
4108 "model_name": "LayoutModel",
4109 "model_module_version": "1.2.0",
4110 "state": {
4111 "_model_module": "@jupyter-widgets/base",
4112 "_model_module_version": "1.2.0",
4113 "_model_name": "LayoutModel",
4114 "_view_count": null,
4115 "_view_module": "@jupyter-widgets/base",
4116 "_view_module_version": "1.2.0",
4117 "_view_name": "LayoutView",
4118 "align_content": null,
4119 "align_items": null,
4120 "align_self": null,
4121 "border": null,
4122 "bottom": null,
4123 "display": null,
4124 "flex": null,
4125 "flex_flow": null,
4126 "grid_area": null,
4127 "grid_auto_columns": null,
4128 "grid_auto_flow": null,
4129 "grid_auto_rows": null,
4130 "grid_column": null,
4131 "grid_gap": null,
4132 "grid_row": null,
4133 "grid_template_areas": null,
4134 "grid_template_columns": null,
4135 "grid_template_rows": null,
4136 "height": null,
4137 "justify_content": null,
4138 "justify_items": null,
4139 "left": null,
4140 "margin": null,
4141 "max_height": null,
4142 "max_width": null,
4143 "min_height": null,
4144 "min_width": null,
4145 "object_fit": null,
4146 "object_position": null,
4147 "order": null,
4148 "overflow": null,
4149 "overflow_x": null,
4150 "overflow_y": null,
4151 "padding": null,
4152 "right": null,
4153 "top": null,
4154 "visibility": null,
4155 "width": null
4156 }
4157 },
4158 "e68df50870c5469a9dc86346d7ad9a4e": {
4159 "model_module": "@jupyter-widgets/controls",
4160 "model_name": "DescriptionStyleModel",
4161 "model_module_version": "1.5.0",
4162 "state": {
4163 "_model_module": "@jupyter-widgets/controls",
4164 "_model_module_version": "1.5.0",
4165 "_model_name": "DescriptionStyleModel",
4166 "_view_count": null,
4167 "_view_module": "@jupyter-widgets/base",
4168 "_view_module_version": "1.2.0",
4169 "_view_name": "StyleView",
4170 "description_width": ""
4171 }
4172 },
4173 "c89c5ec1ca1549cbbc7dd57b3672d74e": {
4174 "model_module": "@jupyter-widgets/base",
4175 "model_name": "LayoutModel",
4176 "model_module_version": "1.2.0",
4177 "state": {
4178 "_model_module": "@jupyter-widgets/base",
4179 "_model_module_version": "1.2.0",
4180 "_model_name": "LayoutModel",
4181 "_view_count": null,
4182 "_view_module": "@jupyter-widgets/base",
4183 "_view_module_version": "1.2.0",
4184 "_view_name": "LayoutView",
4185 "align_content": null,
4186 "align_items": null,
4187 "align_self": null,
4188 "border": null,
4189 "bottom": null,
4190 "display": null,
4191 "flex": "2",
4192 "flex_flow": null,
4193 "grid_area": null,
4194 "grid_auto_columns": null,
4195 "grid_auto_flow": null,
4196 "grid_auto_rows": null,
4197 "grid_column": null,
4198 "grid_gap": null,
4199 "grid_row": null,
4200 "grid_template_areas": null,
4201 "grid_template_columns": null,
4202 "grid_template_rows": null,
4203 "height": null,
4204 "justify_content": null,
4205 "justify_items": null,
4206 "left": null,
4207 "margin": null,
4208 "max_height": null,
4209 "max_width": null,
4210 "min_height": null,
4211 "min_width": null,
4212 "object_fit": null,
4213 "object_position": null,
4214 "order": null,
4215 "overflow": null,
4216 "overflow_x": null,
4217 "overflow_y": null,
4218 "padding": null,
4219 "right": null,
4220 "top": null,
4221 "visibility": null,
4222 "width": null
4223 }
4224 },
4225 "84e423587f4244938844cd74d2f86dc0": {
4226 "model_module": "@jupyter-widgets/controls",
4227 "model_name": "ProgressStyleModel",
4228 "model_module_version": "1.5.0",
4229 "state": {
4230 "_model_module": "@jupyter-widgets/controls",
4231 "_model_module_version": "1.5.0",
4232 "_model_name": "ProgressStyleModel",
4233 "_view_count": null,
4234 "_view_module": "@jupyter-widgets/base",
4235 "_view_module_version": "1.2.0",
4236 "_view_name": "StyleView",
4237 "bar_color": null,
4238 "description_width": ""
4239 }
4240 },
4241 "a31f6ff7fbc54df5bd1745816b2176f8": {
4242 "model_module": "@jupyter-widgets/base",
4243 "model_name": "LayoutModel",
4244 "model_module_version": "1.2.0",
4245 "state": {
4246 "_model_module": "@jupyter-widgets/base",
4247 "_model_module_version": "1.2.0",
4248 "_model_name": "LayoutModel",
4249 "_view_count": null,
4250 "_view_module": "@jupyter-widgets/base",
4251 "_view_module_version": "1.2.0",
4252 "_view_name": "LayoutView",
4253 "align_content": null,
4254 "align_items": null,
4255 "align_self": null,
4256 "border": null,
4257 "bottom": null,
4258 "display": null,
4259 "flex": null,
4260 "flex_flow": null,
4261 "grid_area": null,
4262 "grid_auto_columns": null,
4263 "grid_auto_flow": null,
4264 "grid_auto_rows": null,
4265 "grid_column": null,
4266 "grid_gap": null,
4267 "grid_row": null,
4268 "grid_template_areas": null,
4269 "grid_template_columns": null,
4270 "grid_template_rows": null,
4271 "height": null,
4272 "justify_content": null,
4273 "justify_items": null,
4274 "left": null,
4275 "margin": null,
4276 "max_height": null,
4277 "max_width": null,
4278 "min_height": null,
4279 "min_width": null,
4280 "object_fit": null,
4281 "object_position": null,
4282 "order": null,
4283 "overflow": null,
4284 "overflow_x": null,
4285 "overflow_y": null,
4286 "padding": null,
4287 "right": null,
4288 "top": null,
4289 "visibility": null,
4290 "width": null
4291 }
4292 },
4293 "d6d02c0963c54a6bbbd6753f3c3e6503": {
4294 "model_module": "@jupyter-widgets/controls",
4295 "model_name": "DescriptionStyleModel",
4296 "model_module_version": "1.5.0",
4297 "state": {
4298 "_model_module": "@jupyter-widgets/controls",
4299 "_model_module_version": "1.5.0",
4300 "_model_name": "DescriptionStyleModel",
4301 "_view_count": null,
4302 "_view_module": "@jupyter-widgets/base",
4303 "_view_module_version": "1.2.0",
4304 "_view_name": "StyleView",
4305 "description_width": ""
4306 }
4307 },
4308 "69eedcfbe5c14a4cbe119364ce973690": {
4309 "model_module": "@jupyter-widgets/controls",
4310 "model_name": "HBoxModel",
4311 "model_module_version": "1.5.0",
4312 "state": {
4313 "_dom_classes": [],
4314 "_model_module": "@jupyter-widgets/controls",
4315 "_model_module_version": "1.5.0",
4316 "_model_name": "HBoxModel",
4317 "_view_count": null,
4318 "_view_module": "@jupyter-widgets/controls",
4319 "_view_module_version": "1.5.0",
4320 "_view_name": "HBoxView",
4321 "box_style": "",
4322 "children": [
4323 "IPY_MODEL_72eb0dd423f4486b9a63f100670e03a5",
4324 "IPY_MODEL_4b7e9cfd822d48db848319a78548b0db",
4325 "IPY_MODEL_a52a0bc61ed14e0d93f0c4768687fee8"
4326 ],
4327 "layout": "IPY_MODEL_d1c60311d2bc4f4c826da5c7a634202d"
4328 }
4329 },
4330 "72eb0dd423f4486b9a63f100670e03a5": {
4331 "model_module": "@jupyter-widgets/controls",
4332 "model_name": "HTMLModel",
4333 "model_module_version": "1.5.0",
4334 "state": {
4335 "_dom_classes": [],
4336 "_model_module": "@jupyter-widgets/controls",
4337 "_model_module_version": "1.5.0",
4338 "_model_name": "HTMLModel",
4339 "_view_count": null,
4340 "_view_module": "@jupyter-widgets/controls",
4341 "_view_module_version": "1.5.0",
4342 "_view_name": "HTMLView",
4343 "description": "",
4344 "description_tooltip": null,
4345 "layout": "IPY_MODEL_08426ffc99c44d6290ef9cb9363a5737",
4346 "placeholder": "​",
4347 "style": "IPY_MODEL_161c5cea83dc42f6b87c904303dad688",
4348 "value": "Validation DataLoader 0: 100%"
4349 }
4350 },
4351 "4b7e9cfd822d48db848319a78548b0db": {
4352 "model_module": "@jupyter-widgets/controls",
4353 "model_name": "FloatProgressModel",
4354 "model_module_version": "1.5.0",
4355 "state": {
4356 "_dom_classes": [],
4357 "_model_module": "@jupyter-widgets/controls",
4358 "_model_module_version": "1.5.0",
4359 "_model_name": "FloatProgressModel",
4360 "_view_count": null,
4361 "_view_module": "@jupyter-widgets/controls",
4362 "_view_module_version": "1.5.0",
4363 "_view_name": "ProgressView",
4364 "bar_style": "",
4365 "description": "",
4366 "description_tooltip": null,
4367 "layout": "IPY_MODEL_79c04563af9646dd9a7e82db11894c24",
4368 "max": 1,
4369 "min": 0,
4370 "orientation": "horizontal",
4371 "style": "IPY_MODEL_235b2edd90bf4d1383b5a0d49905a241",
4372 "value": 1
4373 }
4374 },
4375 "a52a0bc61ed14e0d93f0c4768687fee8": {
4376 "model_module": "@jupyter-widgets/controls",
4377 "model_name": "HTMLModel",
4378 "model_module_version": "1.5.0",
4379 "state": {
4380 "_dom_classes": [],
4381 "_model_module": "@jupyter-widgets/controls",
4382 "_model_module_version": "1.5.0",
4383 "_model_name": "HTMLModel",
4384 "_view_count": null,
4385 "_view_module": "@jupyter-widgets/controls",
4386 "_view_module_version": "1.5.0",
4387 "_view_name": "HTMLView",
4388 "description": "",
4389 "description_tooltip": null,
4390 "layout": "IPY_MODEL_24ead65d14c54fbcb174b06b7dadbcc5",
4391 "placeholder": "​",
4392 "style": "IPY_MODEL_20b85c48964d4c85890f8a0ebc04dd1d",
4393 "value": " 1/1 [00:00&lt;00:00, 108.34it/s]"
4394 }
4395 },
4396 "d1c60311d2bc4f4c826da5c7a634202d": {
4397 "model_module": "@jupyter-widgets/base",
4398 "model_name": "LayoutModel",
4399 "model_module_version": "1.2.0",
4400 "state": {
4401 "_model_module": "@jupyter-widgets/base",
4402 "_model_module_version": "1.2.0",
4403 "_model_name": "LayoutModel",
4404 "_view_count": null,
4405 "_view_module": "@jupyter-widgets/base",
4406 "_view_module_version": "1.2.0",
4407 "_view_name": "LayoutView",
4408 "align_content": null,
4409 "align_items": null,
4410 "align_self": null,
4411 "border": null,
4412 "bottom": null,
4413 "display": "inline-flex",
4414 "flex": null,
4415 "flex_flow": "row wrap",
4416 "grid_area": null,
4417 "grid_auto_columns": null,
4418 "grid_auto_flow": null,
4419 "grid_auto_rows": null,
4420 "grid_column": null,
4421 "grid_gap": null,
4422 "grid_row": null,
4423 "grid_template_areas": null,
4424 "grid_template_columns": null,
4425 "grid_template_rows": null,
4426 "height": null,
4427 "justify_content": null,
4428 "justify_items": null,
4429 "left": null,
4430 "margin": null,
4431 "max_height": null,
4432 "max_width": null,
4433 "min_height": null,
4434 "min_width": null,
4435 "object_fit": null,
4436 "object_position": null,
4437 "order": null,
4438 "overflow": null,
4439 "overflow_x": null,
4440 "overflow_y": null,
4441 "padding": null,
4442 "right": null,
4443 "top": null,
4444 "visibility": null,
4445 "width": "100%"
4446 }
4447 },
4448 "08426ffc99c44d6290ef9cb9363a5737": {
4449 "model_module": "@jupyter-widgets/base",
4450 "model_name": "LayoutModel",
4451 "model_module_version": "1.2.0",
4452 "state": {
4453 "_model_module": "@jupyter-widgets/base",
4454 "_model_module_version": "1.2.0",
4455 "_model_name": "LayoutModel",
4456 "_view_count": null,
4457 "_view_module": "@jupyter-widgets/base",
4458 "_view_module_version": "1.2.0",
4459 "_view_name": "LayoutView",
4460 "align_content": null,
4461 "align_items": null,
4462 "align_self": null,
4463 "border": null,
4464 "bottom": null,
4465 "display": null,
4466 "flex": null,
4467 "flex_flow": null,
4468 "grid_area": null,
4469 "grid_auto_columns": null,
4470 "grid_auto_flow": null,
4471 "grid_auto_rows": null,
4472 "grid_column": null,
4473 "grid_gap": null,
4474 "grid_row": null,
4475 "grid_template_areas": null,
4476 "grid_template_columns": null,
4477 "grid_template_rows": null,
4478 "height": null,
4479 "justify_content": null,
4480 "justify_items": null,
4481 "left": null,
4482 "margin": null,
4483 "max_height": null,
4484 "max_width": null,
4485 "min_height": null,
4486 "min_width": null,
4487 "object_fit": null,
4488 "object_position": null,
4489 "order": null,
4490 "overflow": null,
4491 "overflow_x": null,
4492 "overflow_y": null,
4493 "padding": null,
4494 "right": null,
4495 "top": null,
4496 "visibility": null,
4497 "width": null
4498 }
4499 },
4500 "161c5cea83dc42f6b87c904303dad688": {
4501 "model_module": "@jupyter-widgets/controls",
4502 "model_name": "DescriptionStyleModel",
4503 "model_module_version": "1.5.0",
4504 "state": {
4505 "_model_module": "@jupyter-widgets/controls",
4506 "_model_module_version": "1.5.0",
4507 "_model_name": "DescriptionStyleModel",
4508 "_view_count": null,
4509 "_view_module": "@jupyter-widgets/base",
4510 "_view_module_version": "1.2.0",
4511 "_view_name": "StyleView",
4512 "description_width": ""
4513 }
4514 },
4515 "79c04563af9646dd9a7e82db11894c24": {
4516 "model_module": "@jupyter-widgets/base",
4517 "model_name": "LayoutModel",
4518 "model_module_version": "1.2.0",
4519 "state": {
4520 "_model_module": "@jupyter-widgets/base",
4521 "_model_module_version": "1.2.0",
4522 "_model_name": "LayoutModel",
4523 "_view_count": null,
4524 "_view_module": "@jupyter-widgets/base",
4525 "_view_module_version": "1.2.0",
4526 "_view_name": "LayoutView",
4527 "align_content": null,
4528 "align_items": null,
4529 "align_self": null,
4530 "border": null,
4531 "bottom": null,
4532 "display": null,
4533 "flex": "2",
4534 "flex_flow": null,
4535 "grid_area": null,
4536 "grid_auto_columns": null,
4537 "grid_auto_flow": null,
4538 "grid_auto_rows": null,
4539 "grid_column": null,
4540 "grid_gap": null,
4541 "grid_row": null,
4542 "grid_template_areas": null,
4543 "grid_template_columns": null,
4544 "grid_template_rows": null,
4545 "height": null,
4546 "justify_content": null,
4547 "justify_items": null,
4548 "left": null,
4549 "margin": null,
4550 "max_height": null,
4551 "max_width": null,
4552 "min_height": null,
4553 "min_width": null,
4554 "object_fit": null,
4555 "object_position": null,
4556 "order": null,
4557 "overflow": null,
4558 "overflow_x": null,
4559 "overflow_y": null,
4560 "padding": null,
4561 "right": null,
4562 "top": null,
4563 "visibility": null,
4564 "width": null
4565 }
4566 },
4567 "235b2edd90bf4d1383b5a0d49905a241": {
4568 "model_module": "@jupyter-widgets/controls",
4569 "model_name": "ProgressStyleModel",
4570 "model_module_version": "1.5.0",
4571 "state": {
4572 "_model_module": "@jupyter-widgets/controls",
4573 "_model_module_version": "1.5.0",
4574 "_model_name": "ProgressStyleModel",
4575 "_view_count": null,
4576 "_view_module": "@jupyter-widgets/base",
4577 "_view_module_version": "1.2.0",
4578 "_view_name": "StyleView",
4579 "bar_color": null,
4580 "description_width": ""
4581 }
4582 },
4583 "24ead65d14c54fbcb174b06b7dadbcc5": {
4584 "model_module": "@jupyter-widgets/base",
4585 "model_name": "LayoutModel",
4586 "model_module_version": "1.2.0",
4587 "state": {
4588 "_model_module": "@jupyter-widgets/base",
4589 "_model_module_version": "1.2.0",
4590 "_model_name": "LayoutModel",
4591 "_view_count": null,
4592 "_view_module": "@jupyter-widgets/base",
4593 "_view_module_version": "1.2.0",
4594 "_view_name": "LayoutView",
4595 "align_content": null,
4596 "align_items": null,
4597 "align_self": null,
4598 "border": null,
4599 "bottom": null,
4600 "display": null,
4601 "flex": null,
4602 "flex_flow": null,
4603 "grid_area": null,
4604 "grid_auto_columns": null,
4605 "grid_auto_flow": null,
4606 "grid_auto_rows": null,
4607 "grid_column": null,
4608 "grid_gap": null,
4609 "grid_row": null,
4610 "grid_template_areas": null,
4611 "grid_template_columns": null,
4612 "grid_template_rows": null,
4613 "height": null,
4614 "justify_content": null,
4615 "justify_items": null,
4616 "left": null,
4617 "margin": null,
4618 "max_height": null,
4619 "max_width": null,
4620 "min_height": null,
4621 "min_width": null,
4622 "object_fit": null,
4623 "object_position": null,
4624 "order": null,
4625 "overflow": null,
4626 "overflow_x": null,
4627 "overflow_y": null,
4628 "padding": null,
4629 "right": null,
4630 "top": null,
4631 "visibility": null,
4632 "width": null
4633 }
4634 },
4635 "20b85c48964d4c85890f8a0ebc04dd1d": {
4636 "model_module": "@jupyter-widgets/controls",
4637 "model_name": "DescriptionStyleModel",
4638 "model_module_version": "1.5.0",
4639 "state": {
4640 "_model_module": "@jupyter-widgets/controls",
4641 "_model_module_version": "1.5.0",
4642 "_model_name": "DescriptionStyleModel",
4643 "_view_count": null,
4644 "_view_module": "@jupyter-widgets/base",
4645 "_view_module_version": "1.2.0",
4646 "_view_name": "StyleView",
4647 "description_width": ""
4648 }
4649 },
4650 "7287a9afffb5470c920734840c5d72fe": {
4651 "model_module": "@jupyter-widgets/controls",
4652 "model_name": "HBoxModel",
4653 "model_module_version": "1.5.0",
4654 "state": {
4655 "_dom_classes": [],
4656 "_model_module": "@jupyter-widgets/controls",
4657 "_model_module_version": "1.5.0",
4658 "_model_name": "HBoxModel",
4659 "_view_count": null,
4660 "_view_module": "@jupyter-widgets/controls",
4661 "_view_module_version": "1.5.0",
4662 "_view_name": "HBoxView",
4663 "box_style": "",
4664 "children": [
4665 "IPY_MODEL_ae3232c87db9469fa19cb59f78be2f57",
4666 "IPY_MODEL_e2a292f657c342569a080a3d9e25852b",
4667 "IPY_MODEL_f56858c5843d446286d416e9bbc7e7c8"
4668 ],
4669 "layout": "IPY_MODEL_6ddb0e10ea78488aa8358ec3a7bb0780"
4670 }
4671 },
4672 "ae3232c87db9469fa19cb59f78be2f57": {
4673 "model_module": "@jupyter-widgets/controls",
4674 "model_name": "HTMLModel",
4675 "model_module_version": "1.5.0",
4676 "state": {
4677 "_dom_classes": [],
4678 "_model_module": "@jupyter-widgets/controls",
4679 "_model_module_version": "1.5.0",
4680 "_model_name": "HTMLModel",
4681 "_view_count": null,
4682 "_view_module": "@jupyter-widgets/controls",
4683 "_view_module_version": "1.5.0",
4684 "_view_name": "HTMLView",
4685 "description": "",
4686 "description_tooltip": null,
4687 "layout": "IPY_MODEL_df7172162b6542f08662614b084d7521",
4688 "placeholder": "​",
4689 "style": "IPY_MODEL_ca6221d153a94b4898e5a1b5043b843d",
4690 "value": "Validation DataLoader 0: 100%"
4691 }
4692 },
4693 "e2a292f657c342569a080a3d9e25852b": {
4694 "model_module": "@jupyter-widgets/controls",
4695 "model_name": "FloatProgressModel",
4696 "model_module_version": "1.5.0",
4697 "state": {
4698 "_dom_classes": [],
4699 "_model_module": "@jupyter-widgets/controls",
4700 "_model_module_version": "1.5.0",
4701 "_model_name": "FloatProgressModel",
4702 "_view_count": null,
4703 "_view_module": "@jupyter-widgets/controls",
4704 "_view_module_version": "1.5.0",
4705 "_view_name": "ProgressView",
4706 "bar_style": "",
4707 "description": "",
4708 "description_tooltip": null,
4709 "layout": "IPY_MODEL_54e9275a7f074eeca9a5995653d16036",
4710 "max": 1,
4711 "min": 0,
4712 "orientation": "horizontal",
4713 "style": "IPY_MODEL_4454290d993f4350a6dc4e464c61c0a9",
4714 "value": 1
4715 }
4716 },
4717 "f56858c5843d446286d416e9bbc7e7c8": {
4718 "model_module": "@jupyter-widgets/controls",
4719 "model_name": "HTMLModel",
4720 "model_module_version": "1.5.0",
4721 "state": {
4722 "_dom_classes": [],
4723 "_model_module": "@jupyter-widgets/controls",
4724 "_model_module_version": "1.5.0",
4725 "_model_name": "HTMLModel",
4726 "_view_count": null,
4727 "_view_module": "@jupyter-widgets/controls",
4728 "_view_module_version": "1.5.0",
4729 "_view_name": "HTMLView",
4730 "description": "",
4731 "description_tooltip": null,
4732 "layout": "IPY_MODEL_6e5f99b5aec44fff9d4cecb28dd59188",
4733 "placeholder": "​",
4734 "style": "IPY_MODEL_39ae0b5e8b8a41b79ea1a209f2aacc87",
4735 "value": " 1/1 [00:00&lt;00:00, 126.25it/s]"
4736 }
4737 },
4738 "6ddb0e10ea78488aa8358ec3a7bb0780": {
4739 "model_module": "@jupyter-widgets/base",
4740 "model_name": "LayoutModel",
4741 "model_module_version": "1.2.0",
4742 "state": {
4743 "_model_module": "@jupyter-widgets/base",
4744 "_model_module_version": "1.2.0",
4745 "_model_name": "LayoutModel",
4746 "_view_count": null,
4747 "_view_module": "@jupyter-widgets/base",
4748 "_view_module_version": "1.2.0",
4749 "_view_name": "LayoutView",
4750 "align_content": null,
4751 "align_items": null,
4752 "align_self": null,
4753 "border": null,
4754 "bottom": null,
4755 "display": "inline-flex",
4756 "flex": null,
4757 "flex_flow": "row wrap",
4758 "grid_area": null,
4759 "grid_auto_columns": null,
4760 "grid_auto_flow": null,
4761 "grid_auto_rows": null,
4762 "grid_column": null,
4763 "grid_gap": null,
4764 "grid_row": null,
4765 "grid_template_areas": null,
4766 "grid_template_columns": null,
4767 "grid_template_rows": null,
4768 "height": null,
4769 "justify_content": null,
4770 "justify_items": null,
4771 "left": null,
4772 "margin": null,
4773 "max_height": null,
4774 "max_width": null,
4775 "min_height": null,
4776 "min_width": null,
4777 "object_fit": null,
4778 "object_position": null,
4779 "order": null,
4780 "overflow": null,
4781 "overflow_x": null,
4782 "overflow_y": null,
4783 "padding": null,
4784 "right": null,
4785 "top": null,
4786 "visibility": null,
4787 "width": "100%"
4788 }
4789 },
4790 "df7172162b6542f08662614b084d7521": {
4791 "model_module": "@jupyter-widgets/base",
4792 "model_name": "LayoutModel",
4793 "model_module_version": "1.2.0",
4794 "state": {
4795 "_model_module": "@jupyter-widgets/base",
4796 "_model_module_version": "1.2.0",
4797 "_model_name": "LayoutModel",
4798 "_view_count": null,
4799 "_view_module": "@jupyter-widgets/base",
4800 "_view_module_version": "1.2.0",
4801 "_view_name": "LayoutView",
4802 "align_content": null,
4803 "align_items": null,
4804 "align_self": null,
4805 "border": null,
4806 "bottom": null,
4807 "display": null,
4808 "flex": null,
4809 "flex_flow": null,
4810 "grid_area": null,
4811 "grid_auto_columns": null,
4812 "grid_auto_flow": null,
4813 "grid_auto_rows": null,
4814 "grid_column": null,
4815 "grid_gap": null,
4816 "grid_row": null,
4817 "grid_template_areas": null,
4818 "grid_template_columns": null,
4819 "grid_template_rows": null,
4820 "height": null,
4821 "justify_content": null,
4822 "justify_items": null,
4823 "left": null,
4824 "margin": null,
4825 "max_height": null,
4826 "max_width": null,
4827 "min_height": null,
4828 "min_width": null,
4829 "object_fit": null,
4830 "object_position": null,
4831 "order": null,
4832 "overflow": null,
4833 "overflow_x": null,
4834 "overflow_y": null,
4835 "padding": null,
4836 "right": null,
4837 "top": null,
4838 "visibility": null,
4839 "width": null
4840 }
4841 },
4842 "ca6221d153a94b4898e5a1b5043b843d": {
4843 "model_module": "@jupyter-widgets/controls",
4844 "model_name": "DescriptionStyleModel",
4845 "model_module_version": "1.5.0",
4846 "state": {
4847 "_model_module": "@jupyter-widgets/controls",
4848 "_model_module_version": "1.5.0",
4849 "_model_name": "DescriptionStyleModel",
4850 "_view_count": null,
4851 "_view_module": "@jupyter-widgets/base",
4852 "_view_module_version": "1.2.0",
4853 "_view_name": "StyleView",
4854 "description_width": ""
4855 }
4856 },
4857 "54e9275a7f074eeca9a5995653d16036": {
4858 "model_module": "@jupyter-widgets/base",
4859 "model_name": "LayoutModel",
4860 "model_module_version": "1.2.0",
4861 "state": {
4862 "_model_module": "@jupyter-widgets/base",
4863 "_model_module_version": "1.2.0",
4864 "_model_name": "LayoutModel",
4865 "_view_count": null,
4866 "_view_module": "@jupyter-widgets/base",
4867 "_view_module_version": "1.2.0",
4868 "_view_name": "LayoutView",
4869 "align_content": null,
4870 "align_items": null,
4871 "align_self": null,
4872 "border": null,
4873 "bottom": null,
4874 "display": null,
4875 "flex": "2",
4876 "flex_flow": null,
4877 "grid_area": null,
4878 "grid_auto_columns": null,
4879 "grid_auto_flow": null,
4880 "grid_auto_rows": null,
4881 "grid_column": null,
4882 "grid_gap": null,
4883 "grid_row": null,
4884 "grid_template_areas": null,
4885 "grid_template_columns": null,
4886 "grid_template_rows": null,
4887 "height": null,
4888 "justify_content": null,
4889 "justify_items": null,
4890 "left": null,
4891 "margin": null,
4892 "max_height": null,
4893 "max_width": null,
4894 "min_height": null,
4895 "min_width": null,
4896 "object_fit": null,
4897 "object_position": null,
4898 "order": null,
4899 "overflow": null,
4900 "overflow_x": null,
4901 "overflow_y": null,
4902 "padding": null,
4903 "right": null,
4904 "top": null,
4905 "visibility": null,
4906 "width": null
4907 }
4908 },
4909 "4454290d993f4350a6dc4e464c61c0a9": {
4910 "model_module": "@jupyter-widgets/controls",
4911 "model_name": "ProgressStyleModel",
4912 "model_module_version": "1.5.0",
4913 "state": {
4914 "_model_module": "@jupyter-widgets/controls",
4915 "_model_module_version": "1.5.0",
4916 "_model_name": "ProgressStyleModel",
4917 "_view_count": null,
4918 "_view_module": "@jupyter-widgets/base",
4919 "_view_module_version": "1.2.0",
4920 "_view_name": "StyleView",
4921 "bar_color": null,
4922 "description_width": ""
4923 }
4924 },
4925 "6e5f99b5aec44fff9d4cecb28dd59188": {
4926 "model_module": "@jupyter-widgets/base",
4927 "model_name": "LayoutModel",
4928 "model_module_version": "1.2.0",
4929 "state": {
4930 "_model_module": "@jupyter-widgets/base",
4931 "_model_module_version": "1.2.0",
4932 "_model_name": "LayoutModel",
4933 "_view_count": null,
4934 "_view_module": "@jupyter-widgets/base",
4935 "_view_module_version": "1.2.0",
4936 "_view_name": "LayoutView",
4937 "align_content": null,
4938 "align_items": null,
4939 "align_self": null,
4940 "border": null,
4941 "bottom": null,
4942 "display": null,
4943 "flex": null,
4944 "flex_flow": null,
4945 "grid_area": null,
4946 "grid_auto_columns": null,
4947 "grid_auto_flow": null,
4948 "grid_auto_rows": null,
4949 "grid_column": null,
4950 "grid_gap": null,
4951 "grid_row": null,
4952 "grid_template_areas": null,
4953 "grid_template_columns": null,
4954 "grid_template_rows": null,
4955 "height": null,
4956 "justify_content": null,
4957 "justify_items": null,
4958 "left": null,
4959 "margin": null,
4960 "max_height": null,
4961 "max_width": null,
4962 "min_height": null,
4963 "min_width": null,
4964 "object_fit": null,
4965 "object_position": null,
4966 "order": null,
4967 "overflow": null,
4968 "overflow_x": null,
4969 "overflow_y": null,
4970 "padding": null,
4971 "right": null,
4972 "top": null,
4973 "visibility": null,
4974 "width": null
4975 }
4976 },
4977 "39ae0b5e8b8a41b79ea1a209f2aacc87": {
4978 "model_module": "@jupyter-widgets/controls",
4979 "model_name": "DescriptionStyleModel",
4980 "model_module_version": "1.5.0",
4981 "state": {
4982 "_model_module": "@jupyter-widgets/controls",
4983 "_model_module_version": "1.5.0",
4984 "_model_name": "DescriptionStyleModel",
4985 "_view_count": null,
4986 "_view_module": "@jupyter-widgets/base",
4987 "_view_module_version": "1.2.0",
4988 "_view_name": "StyleView",
4989 "description_width": ""
4990 }
4991 },
4992 "08a690202bbe48bf9434a3354cb560c1": {
4993 "model_module": "@jupyter-widgets/controls",
4994 "model_name": "HBoxModel",
4995 "model_module_version": "1.5.0",
4996 "state": {
4997 "_dom_classes": [],
4998 "_model_module": "@jupyter-widgets/controls",
4999 "_model_module_version": "1.5.0",
5000 "_model_name": "HBoxModel",
5001 "_view_count": null,
5002 "_view_module": "@jupyter-widgets/controls",
5003 "_view_module_version": "1.5.0",
5004 "_view_name": "HBoxView",
5005 "box_style": "",
5006 "children": [
5007 "IPY_MODEL_7311cc83255f46ffa31f461c485111b5",
5008 "IPY_MODEL_6f484c87ff3e4582aad771a703151f2b",
5009 "IPY_MODEL_ab9c536f94b84922877071f760111f55"
5010 ],
5011 "layout": "IPY_MODEL_427f04eec07f4d94a010664b12139f0f"
5012 }
5013 },
5014 "7311cc83255f46ffa31f461c485111b5": {
5015 "model_module": "@jupyter-widgets/controls",
5016 "model_name": "HTMLModel",
5017 "model_module_version": "1.5.0",
5018 "state": {
5019 "_dom_classes": [],
5020 "_model_module": "@jupyter-widgets/controls",
5021 "_model_module_version": "1.5.0",
5022 "_model_name": "HTMLModel",
5023 "_view_count": null,
5024 "_view_module": "@jupyter-widgets/controls",
5025 "_view_module_version": "1.5.0",
5026 "_view_name": "HTMLView",
5027 "description": "",
5028 "description_tooltip": null,
5029 "layout": "IPY_MODEL_cd7f66fdfe224994a31a3c985cb7a1de",
5030 "placeholder": "​",
5031 "style": "IPY_MODEL_b74e5502e4e54847b1191b7b0304f66a",
5032 "value": "Validation DataLoader 0: 100%"
5033 }
5034 },
5035 "6f484c87ff3e4582aad771a703151f2b": {
5036 "model_module": "@jupyter-widgets/controls",
5037 "model_name": "FloatProgressModel",
5038 "model_module_version": "1.5.0",
5039 "state": {
5040 "_dom_classes": [],
5041 "_model_module": "@jupyter-widgets/controls",
5042 "_model_module_version": "1.5.0",
5043 "_model_name": "FloatProgressModel",
5044 "_view_count": null,
5045 "_view_module": "@jupyter-widgets/controls",
5046 "_view_module_version": "1.5.0",
5047 "_view_name": "ProgressView",
5048 "bar_style": "",
5049 "description": "",
5050 "description_tooltip": null,
5051 "layout": "IPY_MODEL_dbfcbe2df4f74df594606dd0bb6873b4",
5052 "max": 1,
5053 "min": 0,
5054 "orientation": "horizontal",
5055 "style": "IPY_MODEL_ac62ad773e7a4694b57dd8c71b81f23d",
5056 "value": 1
5057 }
5058 },
5059 "ab9c536f94b84922877071f760111f55": {
5060 "model_module": "@jupyter-widgets/controls",
5061 "model_name": "HTMLModel",
5062 "model_module_version": "1.5.0",
5063 "state": {
5064 "_dom_classes": [],
5065 "_model_module": "@jupyter-widgets/controls",
5066 "_model_module_version": "1.5.0",
5067 "_model_name": "HTMLModel",
5068 "_view_count": null,
5069 "_view_module": "@jupyter-widgets/controls",
5070 "_view_module_version": "1.5.0",
5071 "_view_name": "HTMLView",
5072 "description": "",
5073 "description_tooltip": null,
5074 "layout": "IPY_MODEL_f20824d8dfc84640bee1cdc9b7277caa",
5075 "placeholder": "​",
5076 "style": "IPY_MODEL_fd9a33d8f6ad459594d9939fd635730c",
5077 "value": " 1/1 [00:00&lt;00:00, 105.91it/s]"
5078 }
5079 },
5080 "427f04eec07f4d94a010664b12139f0f": {
5081 "model_module": "@jupyter-widgets/base",
5082 "model_name": "LayoutModel",
5083 "model_module_version": "1.2.0",
5084 "state": {
5085 "_model_module": "@jupyter-widgets/base",
5086 "_model_module_version": "1.2.0",
5087 "_model_name": "LayoutModel",
5088 "_view_count": null,
5089 "_view_module": "@jupyter-widgets/base",
5090 "_view_module_version": "1.2.0",
5091 "_view_name": "LayoutView",
5092 "align_content": null,
5093 "align_items": null,
5094 "align_self": null,
5095 "border": null,
5096 "bottom": null,
5097 "display": "inline-flex",
5098 "flex": null,
5099 "flex_flow": "row wrap",
5100 "grid_area": null,
5101 "grid_auto_columns": null,
5102 "grid_auto_flow": null,
5103 "grid_auto_rows": null,
5104 "grid_column": null,
5105 "grid_gap": null,
5106 "grid_row": null,
5107 "grid_template_areas": null,
5108 "grid_template_columns": null,
5109 "grid_template_rows": null,
5110 "height": null,
5111 "justify_content": null,
5112 "justify_items": null,
5113 "left": null,
5114 "margin": null,
5115 "max_height": null,
5116 "max_width": null,
5117 "min_height": null,
5118 "min_width": null,
5119 "object_fit": null,
5120 "object_position": null,
5121 "order": null,
5122 "overflow": null,
5123 "overflow_x": null,
5124 "overflow_y": null,
5125 "padding": null,
5126 "right": null,
5127 "top": null,
5128 "visibility": null,
5129 "width": "100%"
5130 }
5131 },
5132 "cd7f66fdfe224994a31a3c985cb7a1de": {
5133 "model_module": "@jupyter-widgets/base",
5134 "model_name": "LayoutModel",
5135 "model_module_version": "1.2.0",
5136 "state": {
5137 "_model_module": "@jupyter-widgets/base",
5138 "_model_module_version": "1.2.0",
5139 "_model_name": "LayoutModel",
5140 "_view_count": null,
5141 "_view_module": "@jupyter-widgets/base",
5142 "_view_module_version": "1.2.0",
5143 "_view_name": "LayoutView",
5144 "align_content": null,
5145 "align_items": null,
5146 "align_self": null,
5147 "border": null,
5148 "bottom": null,
5149 "display": null,
5150 "flex": null,
5151 "flex_flow": null,
5152 "grid_area": null,
5153 "grid_auto_columns": null,
5154 "grid_auto_flow": null,
5155 "grid_auto_rows": null,
5156 "grid_column": null,
5157 "grid_gap": null,
5158 "grid_row": null,
5159 "grid_template_areas": null,
5160 "grid_template_columns": null,
5161 "grid_template_rows": null,
5162 "height": null,
5163 "justify_content": null,
5164 "justify_items": null,
5165 "left": null,
5166 "margin": null,
5167 "max_height": null,
5168 "max_width": null,
5169 "min_height": null,
5170 "min_width": null,
5171 "object_fit": null,
5172 "object_position": null,
5173 "order": null,
5174 "overflow": null,
5175 "overflow_x": null,
5176 "overflow_y": null,
5177 "padding": null,
5178 "right": null,
5179 "top": null,
5180 "visibility": null,
5181 "width": null
5182 }
5183 },
5184 "b74e5502e4e54847b1191b7b0304f66a": {
5185 "model_module": "@jupyter-widgets/controls",
5186 "model_name": "DescriptionStyleModel",
5187 "model_module_version": "1.5.0",
5188 "state": {
5189 "_model_module": "@jupyter-widgets/controls",
5190 "_model_module_version": "1.5.0",
5191 "_model_name": "DescriptionStyleModel",
5192 "_view_count": null,
5193 "_view_module": "@jupyter-widgets/base",
5194 "_view_module_version": "1.2.0",
5195 "_view_name": "StyleView",
5196 "description_width": ""
5197 }
5198 },
5199 "dbfcbe2df4f74df594606dd0bb6873b4": {
5200 "model_module": "@jupyter-widgets/base",
5201 "model_name": "LayoutModel",
5202 "model_module_version": "1.2.0",
5203 "state": {
5204 "_model_module": "@jupyter-widgets/base",
5205 "_model_module_version": "1.2.0",
5206 "_model_name": "LayoutModel",
5207 "_view_count": null,
5208 "_view_module": "@jupyter-widgets/base",
5209 "_view_module_version": "1.2.0",
5210 "_view_name": "LayoutView",
5211 "align_content": null,
5212 "align_items": null,
5213 "align_self": null,
5214 "border": null,
5215 "bottom": null,
5216 "display": null,
5217 "flex": "2",
5218 "flex_flow": null,
5219 "grid_area": null,
5220 "grid_auto_columns": null,
5221 "grid_auto_flow": null,
5222 "grid_auto_rows": null,
5223 "grid_column": null,
5224 "grid_gap": null,
5225 "grid_row": null,
5226 "grid_template_areas": null,
5227 "grid_template_columns": null,
5228 "grid_template_rows": null,
5229 "height": null,
5230 "justify_content": null,
5231 "justify_items": null,
5232 "left": null,
5233 "margin": null,
5234 "max_height": null,
5235 "max_width": null,
5236 "min_height": null,
5237 "min_width": null,
5238 "object_fit": null,
5239 "object_position": null,
5240 "order": null,
5241 "overflow": null,
5242 "overflow_x": null,
5243 "overflow_y": null,
5244 "padding": null,
5245 "right": null,
5246 "top": null,
5247 "visibility": null,
5248 "width": null
5249 }
5250 },
5251 "ac62ad773e7a4694b57dd8c71b81f23d": {
5252 "model_module": "@jupyter-widgets/controls",
5253 "model_name": "ProgressStyleModel",
5254 "model_module_version": "1.5.0",
5255 "state": {
5256 "_model_module": "@jupyter-widgets/controls",
5257 "_model_module_version": "1.5.0",
5258 "_model_name": "ProgressStyleModel",
5259 "_view_count": null,
5260 "_view_module": "@jupyter-widgets/base",
5261 "_view_module_version": "1.2.0",
5262 "_view_name": "StyleView",
5263 "bar_color": null,
5264 "description_width": ""
5265 }
5266 },
5267 "f20824d8dfc84640bee1cdc9b7277caa": {
5268 "model_module": "@jupyter-widgets/base",
5269 "model_name": "LayoutModel",
5270 "model_module_version": "1.2.0",
5271 "state": {
5272 "_model_module": "@jupyter-widgets/base",
5273 "_model_module_version": "1.2.0",
5274 "_model_name": "LayoutModel",
5275 "_view_count": null,
5276 "_view_module": "@jupyter-widgets/base",
5277 "_view_module_version": "1.2.0",
5278 "_view_name": "LayoutView",
5279 "align_content": null,
5280 "align_items": null,
5281 "align_self": null,
5282 "border": null,
5283 "bottom": null,
5284 "display": null,
5285 "flex": null,
5286 "flex_flow": null,
5287 "grid_area": null,
5288 "grid_auto_columns": null,
5289 "grid_auto_flow": null,
5290 "grid_auto_rows": null,
5291 "grid_column": null,
5292 "grid_gap": null,
5293 "grid_row": null,
5294 "grid_template_areas": null,
5295 "grid_template_columns": null,
5296 "grid_template_rows": null,
5297 "height": null,
5298 "justify_content": null,
5299 "justify_items": null,
5300 "left": null,
5301 "margin": null,
5302 "max_height": null,
5303 "max_width": null,
5304 "min_height": null,
5305 "min_width": null,
5306 "object_fit": null,
5307 "object_position": null,
5308 "order": null,
5309 "overflow": null,
5310 "overflow_x": null,
5311 "overflow_y": null,
5312 "padding": null,
5313 "right": null,
5314 "top": null,
5315 "visibility": null,
5316 "width": null
5317 }
5318 },
5319 "fd9a33d8f6ad459594d9939fd635730c": {
5320 "model_module": "@jupyter-widgets/controls",
5321 "model_name": "DescriptionStyleModel",
5322 "model_module_version": "1.5.0",
5323 "state": {
5324 "_model_module": "@jupyter-widgets/controls",
5325 "_model_module_version": "1.5.0",
5326 "_model_name": "DescriptionStyleModel",
5327 "_view_count": null,
5328 "_view_module": "@jupyter-widgets/base",
5329 "_view_module_version": "1.2.0",
5330 "_view_name": "StyleView",
5331 "description_width": ""
5332 }
5333 },
5334 "e2900fe753754ede94abc1847dda4d5c": {
5335 "model_module": "@jupyter-widgets/controls",
5336 "model_name": "HBoxModel",
5337 "model_module_version": "1.5.0",
5338 "state": {
5339 "_dom_classes": [],
5340 "_model_module": "@jupyter-widgets/controls",
5341 "_model_module_version": "1.5.0",
5342 "_model_name": "HBoxModel",
5343 "_view_count": null,
5344 "_view_module": "@jupyter-widgets/controls",
5345 "_view_module_version": "1.5.0",
5346 "_view_name": "HBoxView",
5347 "box_style": "",
5348 "children": [
5349 "IPY_MODEL_0c1832e2d1ab4ca4a882d76f1d896c02",
5350 "IPY_MODEL_10a5f4a004bc4a81a485604f67bab642",
5351 "IPY_MODEL_fe260f7a9c66497cad723b44c1addbe7"
5352 ],
5353 "layout": "IPY_MODEL_ef7d39cc71074a7faa299da2621abe03"
5354 }
5355 },
5356 "0c1832e2d1ab4ca4a882d76f1d896c02": {
5357 "model_module": "@jupyter-widgets/controls",
5358 "model_name": "HTMLModel",
5359 "model_module_version": "1.5.0",
5360 "state": {
5361 "_dom_classes": [],
5362 "_model_module": "@jupyter-widgets/controls",
5363 "_model_module_version": "1.5.0",
5364 "_model_name": "HTMLModel",
5365 "_view_count": null,
5366 "_view_module": "@jupyter-widgets/controls",
5367 "_view_module_version": "1.5.0",
5368 "_view_name": "HTMLView",
5369 "description": "",
5370 "description_tooltip": null,
5371 "layout": "IPY_MODEL_3f58e2aea843451b83e3aba8c1eefc74",
5372 "placeholder": "​",
5373 "style": "IPY_MODEL_fd38fbd015e6471392cfee4464e6370e",
5374 "value": "Validation DataLoader 0: 100%"
5375 }
5376 },
5377 "10a5f4a004bc4a81a485604f67bab642": {
5378 "model_module": "@jupyter-widgets/controls",
5379 "model_name": "FloatProgressModel",
5380 "model_module_version": "1.5.0",
5381 "state": {
5382 "_dom_classes": [],
5383 "_model_module": "@jupyter-widgets/controls",
5384 "_model_module_version": "1.5.0",
5385 "_model_name": "FloatProgressModel",
5386 "_view_count": null,
5387 "_view_module": "@jupyter-widgets/controls",
5388 "_view_module_version": "1.5.0",
5389 "_view_name": "ProgressView",
5390 "bar_style": "",
5391 "description": "",
5392 "description_tooltip": null,
5393 "layout": "IPY_MODEL_a95c45bcb67f4a569fb9f88af8108fde",
5394 "max": 1,
5395 "min": 0,
5396 "orientation": "horizontal",
5397 "style": "IPY_MODEL_bf3bf33f0c474b54a4b472a4a7626da7",
5398 "value": 1
5399 }
5400 },
5401 "fe260f7a9c66497cad723b44c1addbe7": {
5402 "model_module": "@jupyter-widgets/controls",
5403 "model_name": "HTMLModel",
5404 "model_module_version": "1.5.0",
5405 "state": {
5406 "_dom_classes": [],
5407 "_model_module": "@jupyter-widgets/controls",
5408 "_model_module_version": "1.5.0",
5409 "_model_name": "HTMLModel",
5410 "_view_count": null,
5411 "_view_module": "@jupyter-widgets/controls",
5412 "_view_module_version": "1.5.0",
5413 "_view_name": "HTMLView",
5414 "description": "",
5415 "description_tooltip": null,
5416 "layout": "IPY_MODEL_afcc785f069b433ba8747b01e5840763",
5417 "placeholder": "​",
5418 "style": "IPY_MODEL_ec27c6b290be4adc8d2df034fd3bb143",
5419 "value": " 1/1 [00:00&lt;00:00, 110.76it/s]"
5420 }
5421 },
5422 "ef7d39cc71074a7faa299da2621abe03": {
5423 "model_module": "@jupyter-widgets/base",
5424 "model_name": "LayoutModel",
5425 "model_module_version": "1.2.0",
5426 "state": {
5427 "_model_module": "@jupyter-widgets/base",
5428 "_model_module_version": "1.2.0",
5429 "_model_name": "LayoutModel",
5430 "_view_count": null,
5431 "_view_module": "@jupyter-widgets/base",
5432 "_view_module_version": "1.2.0",
5433 "_view_name": "LayoutView",
5434 "align_content": null,
5435 "align_items": null,
5436 "align_self": null,
5437 "border": null,
5438 "bottom": null,
5439 "display": "inline-flex",
5440 "flex": null,
5441 "flex_flow": "row wrap",
5442 "grid_area": null,
5443 "grid_auto_columns": null,
5444 "grid_auto_flow": null,
5445 "grid_auto_rows": null,
5446 "grid_column": null,
5447 "grid_gap": null,
5448 "grid_row": null,
5449 "grid_template_areas": null,
5450 "grid_template_columns": null,
5451 "grid_template_rows": null,
5452 "height": null,
5453 "justify_content": null,
5454 "justify_items": null,
5455 "left": null,
5456 "margin": null,
5457 "max_height": null,
5458 "max_width": null,
5459 "min_height": null,
5460 "min_width": null,
5461 "object_fit": null,
5462 "object_position": null,
5463 "order": null,
5464 "overflow": null,
5465 "overflow_x": null,
5466 "overflow_y": null,
5467 "padding": null,
5468 "right": null,
5469 "top": null,
5470 "visibility": null,
5471 "width": "100%"
5472 }
5473 },
5474 "3f58e2aea843451b83e3aba8c1eefc74": {
5475 "model_module": "@jupyter-widgets/base",
5476 "model_name": "LayoutModel",
5477 "model_module_version": "1.2.0",
5478 "state": {
5479 "_model_module": "@jupyter-widgets/base",
5480 "_model_module_version": "1.2.0",
5481 "_model_name": "LayoutModel",
5482 "_view_count": null,
5483 "_view_module": "@jupyter-widgets/base",
5484 "_view_module_version": "1.2.0",
5485 "_view_name": "LayoutView",
5486 "align_content": null,
5487 "align_items": null,
5488 "align_self": null,
5489 "border": null,
5490 "bottom": null,
5491 "display": null,
5492 "flex": null,
5493 "flex_flow": null,
5494 "grid_area": null,
5495 "grid_auto_columns": null,
5496 "grid_auto_flow": null,
5497 "grid_auto_rows": null,
5498 "grid_column": null,
5499 "grid_gap": null,
5500 "grid_row": null,
5501 "grid_template_areas": null,
5502 "grid_template_columns": null,
5503 "grid_template_rows": null,
5504 "height": null,
5505 "justify_content": null,
5506 "justify_items": null,
5507 "left": null,
5508 "margin": null,
5509 "max_height": null,
5510 "max_width": null,
5511 "min_height": null,
5512 "min_width": null,
5513 "object_fit": null,
5514 "object_position": null,
5515 "order": null,
5516 "overflow": null,
5517 "overflow_x": null,
5518 "overflow_y": null,
5519 "padding": null,
5520 "right": null,
5521 "top": null,
5522 "visibility": null,
5523 "width": null
5524 }
5525 },
5526 "fd38fbd015e6471392cfee4464e6370e": {
5527 "model_module": "@jupyter-widgets/controls",
5528 "model_name": "DescriptionStyleModel",
5529 "model_module_version": "1.5.0",
5530 "state": {
5531 "_model_module": "@jupyter-widgets/controls",
5532 "_model_module_version": "1.5.0",
5533 "_model_name": "DescriptionStyleModel",
5534 "_view_count": null,
5535 "_view_module": "@jupyter-widgets/base",
5536 "_view_module_version": "1.2.0",
5537 "_view_name": "StyleView",
5538 "description_width": ""
5539 }
5540 },
5541 "a95c45bcb67f4a569fb9f88af8108fde": {
5542 "model_module": "@jupyter-widgets/base",
5543 "model_name": "LayoutModel",
5544 "model_module_version": "1.2.0",
5545 "state": {
5546 "_model_module": "@jupyter-widgets/base",
5547 "_model_module_version": "1.2.0",
5548 "_model_name": "LayoutModel",
5549 "_view_count": null,
5550 "_view_module": "@jupyter-widgets/base",
5551 "_view_module_version": "1.2.0",
5552 "_view_name": "LayoutView",
5553 "align_content": null,
5554 "align_items": null,
5555 "align_self": null,
5556 "border": null,
5557 "bottom": null,
5558 "display": null,
5559 "flex": "2",
5560 "flex_flow": null,
5561 "grid_area": null,
5562 "grid_auto_columns": null,
5563 "grid_auto_flow": null,
5564 "grid_auto_rows": null,
5565 "grid_column": null,
5566 "grid_gap": null,
5567 "grid_row": null,
5568 "grid_template_areas": null,
5569 "grid_template_columns": null,
5570 "grid_template_rows": null,
5571 "height": null,
5572 "justify_content": null,
5573 "justify_items": null,
5574 "left": null,
5575 "margin": null,
5576 "max_height": null,
5577 "max_width": null,
5578 "min_height": null,
5579 "min_width": null,
5580 "object_fit": null,
5581 "object_position": null,
5582 "order": null,
5583 "overflow": null,
5584 "overflow_x": null,
5585 "overflow_y": null,
5586 "padding": null,
5587 "right": null,
5588 "top": null,
5589 "visibility": null,
5590 "width": null
5591 }
5592 },
5593 "bf3bf33f0c474b54a4b472a4a7626da7": {
5594 "model_module": "@jupyter-widgets/controls",
5595 "model_name": "ProgressStyleModel",
5596 "model_module_version": "1.5.0",
5597 "state": {
5598 "_model_module": "@jupyter-widgets/controls",
5599 "_model_module_version": "1.5.0",
5600 "_model_name": "ProgressStyleModel",
5601 "_view_count": null,
5602 "_view_module": "@jupyter-widgets/base",
5603 "_view_module_version": "1.2.0",
5604 "_view_name": "StyleView",
5605 "bar_color": null,
5606 "description_width": ""
5607 }
5608 },
5609 "afcc785f069b433ba8747b01e5840763": {
5610 "model_module": "@jupyter-widgets/base",
5611 "model_name": "LayoutModel",
5612 "model_module_version": "1.2.0",
5613 "state": {
5614 "_model_module": "@jupyter-widgets/base",
5615 "_model_module_version": "1.2.0",
5616 "_model_name": "LayoutModel",
5617 "_view_count": null,
5618 "_view_module": "@jupyter-widgets/base",
5619 "_view_module_version": "1.2.0",
5620 "_view_name": "LayoutView",
5621 "align_content": null,
5622 "align_items": null,
5623 "align_self": null,
5624 "border": null,
5625 "bottom": null,
5626 "display": null,
5627 "flex": null,
5628 "flex_flow": null,
5629 "grid_area": null,
5630 "grid_auto_columns": null,
5631 "grid_auto_flow": null,
5632 "grid_auto_rows": null,
5633 "grid_column": null,
5634 "grid_gap": null,
5635 "grid_row": null,
5636 "grid_template_areas": null,
5637 "grid_template_columns": null,
5638 "grid_template_rows": null,
5639 "height": null,
5640 "justify_content": null,
5641 "justify_items": null,
5642 "left": null,
5643 "margin": null,
5644 "max_height": null,
5645 "max_width": null,
5646 "min_height": null,
5647 "min_width": null,
5648 "object_fit": null,
5649 "object_position": null,
5650 "order": null,
5651 "overflow": null,
5652 "overflow_x": null,
5653 "overflow_y": null,
5654 "padding": null,
5655 "right": null,
5656 "top": null,
5657 "visibility": null,
5658 "width": null
5659 }
5660 },
5661 "ec27c6b290be4adc8d2df034fd3bb143": {
5662 "model_module": "@jupyter-widgets/controls",
5663 "model_name": "DescriptionStyleModel",
5664 "model_module_version": "1.5.0",
5665 "state": {
5666 "_model_module": "@jupyter-widgets/controls",
5667 "_model_module_version": "1.5.0",
5668 "_model_name": "DescriptionStyleModel",
5669 "_view_count": null,
5670 "_view_module": "@jupyter-widgets/base",
5671 "_view_module_version": "1.2.0",
5672 "_view_name": "StyleView",
5673 "description_width": ""
5674 }
5675 },
5676 "0d2b1608b987468791e1a7ffedfd0079": {
5677 "model_module": "@jupyter-widgets/controls",
5678 "model_name": "HBoxModel",
5679 "model_module_version": "1.5.0",
5680 "state": {
5681 "_dom_classes": [],
5682 "_model_module": "@jupyter-widgets/controls",
5683 "_model_module_version": "1.5.0",
5684 "_model_name": "HBoxModel",
5685 "_view_count": null,
5686 "_view_module": "@jupyter-widgets/controls",
5687 "_view_module_version": "1.5.0",
5688 "_view_name": "HBoxView",
5689 "box_style": "",
5690 "children": [
5691 "IPY_MODEL_016a5fc3757c480b9c905867c4892864",
5692 "IPY_MODEL_c7c7cc7d1c0647abb11ade78ef451007",
5693 "IPY_MODEL_d0e4462fee034a67b3682e27d5cb6e27"
5694 ],
5695 "layout": "IPY_MODEL_ac3a80de351440e7a279f3efce37e430"
5696 }
5697 },
5698 "016a5fc3757c480b9c905867c4892864": {
5699 "model_module": "@jupyter-widgets/controls",
5700 "model_name": "HTMLModel",
5701 "model_module_version": "1.5.0",
5702 "state": {
5703 "_dom_classes": [],
5704 "_model_module": "@jupyter-widgets/controls",
5705 "_model_module_version": "1.5.0",
5706 "_model_name": "HTMLModel",
5707 "_view_count": null,
5708 "_view_module": "@jupyter-widgets/controls",
5709 "_view_module_version": "1.5.0",
5710 "_view_name": "HTMLView",
5711 "description": "",
5712 "description_tooltip": null,
5713 "layout": "IPY_MODEL_d6204036abba495785a3674ea841746c",
5714 "placeholder": "​",
5715 "style": "IPY_MODEL_3df8a54d12604c1ebe7229f88d5811bf",
5716 "value": "Validation DataLoader 0: 100%"
5717 }
5718 },
5719 "c7c7cc7d1c0647abb11ade78ef451007": {
5720 "model_module": "@jupyter-widgets/controls",
5721 "model_name": "FloatProgressModel",
5722 "model_module_version": "1.5.0",
5723 "state": {
5724 "_dom_classes": [],
5725 "_model_module": "@jupyter-widgets/controls",
5726 "_model_module_version": "1.5.0",
5727 "_model_name": "FloatProgressModel",
5728 "_view_count": null,
5729 "_view_module": "@jupyter-widgets/controls",
5730 "_view_module_version": "1.5.0",
5731 "_view_name": "ProgressView",
5732 "bar_style": "",
5733 "description": "",
5734 "description_tooltip": null,
5735 "layout": "IPY_MODEL_5236935ed5874a0986f953ee21477be9",
5736 "max": 1,
5737 "min": 0,
5738 "orientation": "horizontal",
5739 "style": "IPY_MODEL_1355273e058041efa299727d17949855",
5740 "value": 1
5741 }
5742 },
5743 "d0e4462fee034a67b3682e27d5cb6e27": {
5744 "model_module": "@jupyter-widgets/controls",
5745 "model_name": "HTMLModel",
5746 "model_module_version": "1.5.0",
5747 "state": {
5748 "_dom_classes": [],
5749 "_model_module": "@jupyter-widgets/controls",
5750 "_model_module_version": "1.5.0",
5751 "_model_name": "HTMLModel",
5752 "_view_count": null,
5753 "_view_module": "@jupyter-widgets/controls",
5754 "_view_module_version": "1.5.0",
5755 "_view_name": "HTMLView",
5756 "description": "",
5757 "description_tooltip": null,
5758 "layout": "IPY_MODEL_68acf21436374d5eb393ada1b2298e28",
5759 "placeholder": "​",
5760 "style": "IPY_MODEL_57d592b9768545869080fc2505e5a770",
5761 "value": " 1/1 [00:00&lt;00:00, 97.42it/s]"
5762 }
5763 },
5764 "ac3a80de351440e7a279f3efce37e430": {
5765 "model_module": "@jupyter-widgets/base",
5766 "model_name": "LayoutModel",
5767 "model_module_version": "1.2.0",
5768 "state": {
5769 "_model_module": "@jupyter-widgets/base",
5770 "_model_module_version": "1.2.0",
5771 "_model_name": "LayoutModel",
5772 "_view_count": null,
5773 "_view_module": "@jupyter-widgets/base",
5774 "_view_module_version": "1.2.0",
5775 "_view_name": "LayoutView",
5776 "align_content": null,
5777 "align_items": null,
5778 "align_self": null,
5779 "border": null,
5780 "bottom": null,
5781 "display": "inline-flex",
5782 "flex": null,
5783 "flex_flow": "row wrap",
5784 "grid_area": null,
5785 "grid_auto_columns": null,
5786 "grid_auto_flow": null,
5787 "grid_auto_rows": null,
5788 "grid_column": null,
5789 "grid_gap": null,
5790 "grid_row": null,
5791 "grid_template_areas": null,
5792 "grid_template_columns": null,
5793 "grid_template_rows": null,
5794 "height": null,
5795 "justify_content": null,
5796 "justify_items": null,
5797 "left": null,
5798 "margin": null,
5799 "max_height": null,
5800 "max_width": null,
5801 "min_height": null,
5802 "min_width": null,
5803 "object_fit": null,
5804 "object_position": null,
5805 "order": null,
5806 "overflow": null,
5807 "overflow_x": null,
5808 "overflow_y": null,
5809 "padding": null,
5810 "right": null,
5811 "top": null,
5812 "visibility": null,
5813 "width": "100%"
5814 }
5815 },
5816 "d6204036abba495785a3674ea841746c": {
5817 "model_module": "@jupyter-widgets/base",
5818 "model_name": "LayoutModel",
5819 "model_module_version": "1.2.0",
5820 "state": {
5821 "_model_module": "@jupyter-widgets/base",
5822 "_model_module_version": "1.2.0",
5823 "_model_name": "LayoutModel",
5824 "_view_count": null,
5825 "_view_module": "@jupyter-widgets/base",
5826 "_view_module_version": "1.2.0",
5827 "_view_name": "LayoutView",
5828 "align_content": null,
5829 "align_items": null,
5830 "align_self": null,
5831 "border": null,
5832 "bottom": null,
5833 "display": null,
5834 "flex": null,
5835 "flex_flow": null,
5836 "grid_area": null,
5837 "grid_auto_columns": null,
5838 "grid_auto_flow": null,
5839 "grid_auto_rows": null,
5840 "grid_column": null,
5841 "grid_gap": null,
5842 "grid_row": null,
5843 "grid_template_areas": null,
5844 "grid_template_columns": null,
5845 "grid_template_rows": null,
5846 "height": null,
5847 "justify_content": null,
5848 "justify_items": null,
5849 "left": null,
5850 "margin": null,
5851 "max_height": null,
5852 "max_width": null,
5853 "min_height": null,
5854 "min_width": null,
5855 "object_fit": null,
5856 "object_position": null,
5857 "order": null,
5858 "overflow": null,
5859 "overflow_x": null,
5860 "overflow_y": null,
5861 "padding": null,
5862 "right": null,
5863 "top": null,
5864 "visibility": null,
5865 "width": null
5866 }
5867 },
5868 "3df8a54d12604c1ebe7229f88d5811bf": {
5869 "model_module": "@jupyter-widgets/controls",
5870 "model_name": "DescriptionStyleModel",
5871 "model_module_version": "1.5.0",
5872 "state": {
5873 "_model_module": "@jupyter-widgets/controls",
5874 "_model_module_version": "1.5.0",
5875 "_model_name": "DescriptionStyleModel",
5876 "_view_count": null,
5877 "_view_module": "@jupyter-widgets/base",
5878 "_view_module_version": "1.2.0",
5879 "_view_name": "StyleView",
5880 "description_width": ""
5881 }
5882 },
5883 "5236935ed5874a0986f953ee21477be9": {
5884 "model_module": "@jupyter-widgets/base",
5885 "model_name": "LayoutModel",
5886 "model_module_version": "1.2.0",
5887 "state": {
5888 "_model_module": "@jupyter-widgets/base",
5889 "_model_module_version": "1.2.0",
5890 "_model_name": "LayoutModel",
5891 "_view_count": null,
5892 "_view_module": "@jupyter-widgets/base",
5893 "_view_module_version": "1.2.0",
5894 "_view_name": "LayoutView",
5895 "align_content": null,
5896 "align_items": null,
5897 "align_self": null,
5898 "border": null,
5899 "bottom": null,
5900 "display": null,
5901 "flex": "2",
5902 "flex_flow": null,
5903 "grid_area": null,
5904 "grid_auto_columns": null,
5905 "grid_auto_flow": null,
5906 "grid_auto_rows": null,
5907 "grid_column": null,
5908 "grid_gap": null,
5909 "grid_row": null,
5910 "grid_template_areas": null,
5911 "grid_template_columns": null,
5912 "grid_template_rows": null,
5913 "height": null,
5914 "justify_content": null,
5915 "justify_items": null,
5916 "left": null,
5917 "margin": null,
5918 "max_height": null,
5919 "max_width": null,
5920 "min_height": null,
5921 "min_width": null,
5922 "object_fit": null,
5923 "object_position": null,
5924 "order": null,
5925 "overflow": null,
5926 "overflow_x": null,
5927 "overflow_y": null,
5928 "padding": null,
5929 "right": null,
5930 "top": null,
5931 "visibility": null,
5932 "width": null
5933 }
5934 },
5935 "1355273e058041efa299727d17949855": {
5936 "model_module": "@jupyter-widgets/controls",
5937 "model_name": "ProgressStyleModel",
5938 "model_module_version": "1.5.0",
5939 "state": {
5940 "_model_module": "@jupyter-widgets/controls",
5941 "_model_module_version": "1.5.0",
5942 "_model_name": "ProgressStyleModel",
5943 "_view_count": null,
5944 "_view_module": "@jupyter-widgets/base",
5945 "_view_module_version": "1.2.0",
5946 "_view_name": "StyleView",
5947 "bar_color": null,
5948 "description_width": ""
5949 }
5950 },
5951 "68acf21436374d5eb393ada1b2298e28": {
5952 "model_module": "@jupyter-widgets/base",
5953 "model_name": "LayoutModel",
5954 "model_module_version": "1.2.0",
5955 "state": {
5956 "_model_module": "@jupyter-widgets/base",
5957 "_model_module_version": "1.2.0",
5958 "_model_name": "LayoutModel",
5959 "_view_count": null,
5960 "_view_module": "@jupyter-widgets/base",
5961 "_view_module_version": "1.2.0",
5962 "_view_name": "LayoutView",
5963 "align_content": null,
5964 "align_items": null,
5965 "align_self": null,
5966 "border": null,
5967 "bottom": null,
5968 "display": null,
5969 "flex": null,
5970 "flex_flow": null,
5971 "grid_area": null,
5972 "grid_auto_columns": null,
5973 "grid_auto_flow": null,
5974 "grid_auto_rows": null,
5975 "grid_column": null,
5976 "grid_gap": null,
5977 "grid_row": null,
5978 "grid_template_areas": null,
5979 "grid_template_columns": null,
5980 "grid_template_rows": null,
5981 "height": null,
5982 "justify_content": null,
5983 "justify_items": null,
5984 "left": null,
5985 "margin": null,
5986 "max_height": null,
5987 "max_width": null,
5988 "min_height": null,
5989 "min_width": null,
5990 "object_fit": null,
5991 "object_position": null,
5992 "order": null,
5993 "overflow": null,
5994 "overflow_x": null,
5995 "overflow_y": null,
5996 "padding": null,
5997 "right": null,
5998 "top": null,
5999 "visibility": null,
6000 "width": null
6001 }
6002 },
6003 "57d592b9768545869080fc2505e5a770": {
6004 "model_module": "@jupyter-widgets/controls",
6005 "model_name": "DescriptionStyleModel",
6006 "model_module_version": "1.5.0",
6007 "state": {
6008 "_model_module": "@jupyter-widgets/controls",
6009 "_model_module_version": "1.5.0",
6010 "_model_name": "DescriptionStyleModel",
6011 "_view_count": null,
6012 "_view_module": "@jupyter-widgets/base",
6013 "_view_module_version": "1.2.0",
6014 "_view_name": "StyleView",
6015 "description_width": ""
6016 }
6017 },
6018 "b650b7b4420541298ea255d741f8a518": {
6019 "model_module": "@jupyter-widgets/controls",
6020 "model_name": "HBoxModel",
6021 "model_module_version": "1.5.0",
6022 "state": {
6023 "_dom_classes": [],
6024 "_model_module": "@jupyter-widgets/controls",
6025 "_model_module_version": "1.5.0",
6026 "_model_name": "HBoxModel",
6027 "_view_count": null,
6028 "_view_module": "@jupyter-widgets/controls",
6029 "_view_module_version": "1.5.0",
6030 "_view_name": "HBoxView",
6031 "box_style": "",
6032 "children": [
6033 "IPY_MODEL_3d0949a3f0504bf0802082ec86ce8e17",
6034 "IPY_MODEL_3f71570951c94959ba0eea6692b2d671",
6035 "IPY_MODEL_15f97cc51d594cca91dc43cbf019ffbc"
6036 ],
6037 "layout": "IPY_MODEL_23e7ec609ed649e29f2c274bd76ee3dd"
6038 }
6039 },
6040 "3d0949a3f0504bf0802082ec86ce8e17": {
6041 "model_module": "@jupyter-widgets/controls",
6042 "model_name": "HTMLModel",
6043 "model_module_version": "1.5.0",
6044 "state": {
6045 "_dom_classes": [],
6046 "_model_module": "@jupyter-widgets/controls",
6047 "_model_module_version": "1.5.0",
6048 "_model_name": "HTMLModel",
6049 "_view_count": null,
6050 "_view_module": "@jupyter-widgets/controls",
6051 "_view_module_version": "1.5.0",
6052 "_view_name": "HTMLView",
6053 "description": "",
6054 "description_tooltip": null,
6055 "layout": "IPY_MODEL_47af905082094cd5b8a4cb4ab02ec431",
6056 "placeholder": "​",
6057 "style": "IPY_MODEL_87aa955f31054e7da3fc1c93a8e1f335",
6058 "value": "Validation DataLoader 0: 100%"
6059 }
6060 },
6061 "3f71570951c94959ba0eea6692b2d671": {
6062 "model_module": "@jupyter-widgets/controls",
6063 "model_name": "FloatProgressModel",
6064 "model_module_version": "1.5.0",
6065 "state": {
6066 "_dom_classes": [],
6067 "_model_module": "@jupyter-widgets/controls",
6068 "_model_module_version": "1.5.0",
6069 "_model_name": "FloatProgressModel",
6070 "_view_count": null,
6071 "_view_module": "@jupyter-widgets/controls",
6072 "_view_module_version": "1.5.0",
6073 "_view_name": "ProgressView",
6074 "bar_style": "",
6075 "description": "",
6076 "description_tooltip": null,
6077 "layout": "IPY_MODEL_2f79b8377db841b5b14650ed14d7c5cb",
6078 "max": 1,
6079 "min": 0,
6080 "orientation": "horizontal",
6081 "style": "IPY_MODEL_0560fb1045034e4b865a199dc0fba636",
6082 "value": 1
6083 }
6084 },
6085 "15f97cc51d594cca91dc43cbf019ffbc": {
6086 "model_module": "@jupyter-widgets/controls",
6087 "model_name": "HTMLModel",
6088 "model_module_version": "1.5.0",
6089 "state": {
6090 "_dom_classes": [],
6091 "_model_module": "@jupyter-widgets/controls",
6092 "_model_module_version": "1.5.0",
6093 "_model_name": "HTMLModel",
6094 "_view_count": null,
6095 "_view_module": "@jupyter-widgets/controls",
6096 "_view_module_version": "1.5.0",
6097 "_view_name": "HTMLView",
6098 "description": "",
6099 "description_tooltip": null,
6100 "layout": "IPY_MODEL_e35861641d664e2ea8140ff988b65576",
6101 "placeholder": "​",
6102 "style": "IPY_MODEL_4d683f5e6ccb4328bfd33829e05e2e35",
6103 "value": " 1/1 [00:00&lt;00:00, 101.72it/s]"
6104 }
6105 },
6106 "23e7ec609ed649e29f2c274bd76ee3dd": {
6107 "model_module": "@jupyter-widgets/base",
6108 "model_name": "LayoutModel",
6109 "model_module_version": "1.2.0",
6110 "state": {
6111 "_model_module": "@jupyter-widgets/base",
6112 "_model_module_version": "1.2.0",
6113 "_model_name": "LayoutModel",
6114 "_view_count": null,
6115 "_view_module": "@jupyter-widgets/base",
6116 "_view_module_version": "1.2.0",
6117 "_view_name": "LayoutView",
6118 "align_content": null,
6119 "align_items": null,
6120 "align_self": null,
6121 "border": null,
6122 "bottom": null,
6123 "display": "inline-flex",
6124 "flex": null,
6125 "flex_flow": "row wrap",
6126 "grid_area": null,
6127 "grid_auto_columns": null,
6128 "grid_auto_flow": null,
6129 "grid_auto_rows": null,
6130 "grid_column": null,
6131 "grid_gap": null,
6132 "grid_row": null,
6133 "grid_template_areas": null,
6134 "grid_template_columns": null,
6135 "grid_template_rows": null,
6136 "height": null,
6137 "justify_content": null,
6138 "justify_items": null,
6139 "left": null,
6140 "margin": null,
6141 "max_height": null,
6142 "max_width": null,
6143 "min_height": null,
6144 "min_width": null,
6145 "object_fit": null,
6146 "object_position": null,
6147 "order": null,
6148 "overflow": null,
6149 "overflow_x": null,
6150 "overflow_y": null,
6151 "padding": null,
6152 "right": null,
6153 "top": null,
6154 "visibility": null,
6155 "width": "100%"
6156 }
6157 },
6158 "47af905082094cd5b8a4cb4ab02ec431": {
6159 "model_module": "@jupyter-widgets/base",
6160 "model_name": "LayoutModel",
6161 "model_module_version": "1.2.0",
6162 "state": {
6163 "_model_module": "@jupyter-widgets/base",
6164 "_model_module_version": "1.2.0",
6165 "_model_name": "LayoutModel",
6166 "_view_count": null,
6167 "_view_module": "@jupyter-widgets/base",
6168 "_view_module_version": "1.2.0",
6169 "_view_name": "LayoutView",
6170 "align_content": null,
6171 "align_items": null,
6172 "align_self": null,
6173 "border": null,
6174 "bottom": null,
6175 "display": null,
6176 "flex": null,
6177 "flex_flow": null,
6178 "grid_area": null,
6179 "grid_auto_columns": null,
6180 "grid_auto_flow": null,
6181 "grid_auto_rows": null,
6182 "grid_column": null,
6183 "grid_gap": null,
6184 "grid_row": null,
6185 "grid_template_areas": null,
6186 "grid_template_columns": null,
6187 "grid_template_rows": null,
6188 "height": null,
6189 "justify_content": null,
6190 "justify_items": null,
6191 "left": null,
6192 "margin": null,
6193 "max_height": null,
6194 "max_width": null,
6195 "min_height": null,
6196 "min_width": null,
6197 "object_fit": null,
6198 "object_position": null,
6199 "order": null,
6200 "overflow": null,
6201 "overflow_x": null,
6202 "overflow_y": null,
6203 "padding": null,
6204 "right": null,
6205 "top": null,
6206 "visibility": null,
6207 "width": null
6208 }
6209 },
6210 "87aa955f31054e7da3fc1c93a8e1f335": {
6211 "model_module": "@jupyter-widgets/controls",
6212 "model_name": "DescriptionStyleModel",
6213 "model_module_version": "1.5.0",
6214 "state": {
6215 "_model_module": "@jupyter-widgets/controls",
6216 "_model_module_version": "1.5.0",
6217 "_model_name": "DescriptionStyleModel",
6218 "_view_count": null,
6219 "_view_module": "@jupyter-widgets/base",
6220 "_view_module_version": "1.2.0",
6221 "_view_name": "StyleView",
6222 "description_width": ""
6223 }
6224 },
6225 "2f79b8377db841b5b14650ed14d7c5cb": {
6226 "model_module": "@jupyter-widgets/base",
6227 "model_name": "LayoutModel",
6228 "model_module_version": "1.2.0",
6229 "state": {
6230 "_model_module": "@jupyter-widgets/base",
6231 "_model_module_version": "1.2.0",
6232 "_model_name": "LayoutModel",
6233 "_view_count": null,
6234 "_view_module": "@jupyter-widgets/base",
6235 "_view_module_version": "1.2.0",
6236 "_view_name": "LayoutView",
6237 "align_content": null,
6238 "align_items": null,
6239 "align_self": null,
6240 "border": null,
6241 "bottom": null,
6242 "display": null,
6243 "flex": "2",
6244 "flex_flow": null,
6245 "grid_area": null,
6246 "grid_auto_columns": null,
6247 "grid_auto_flow": null,
6248 "grid_auto_rows": null,
6249 "grid_column": null,
6250 "grid_gap": null,
6251 "grid_row": null,
6252 "grid_template_areas": null,
6253 "grid_template_columns": null,
6254 "grid_template_rows": null,
6255 "height": null,
6256 "justify_content": null,
6257 "justify_items": null,
6258 "left": null,
6259 "margin": null,
6260 "max_height": null,
6261 "max_width": null,
6262 "min_height": null,
6263 "min_width": null,
6264 "object_fit": null,
6265 "object_position": null,
6266 "order": null,
6267 "overflow": null,
6268 "overflow_x": null,
6269 "overflow_y": null,
6270 "padding": null,
6271 "right": null,
6272 "top": null,
6273 "visibility": null,
6274 "width": null
6275 }
6276 },
6277 "0560fb1045034e4b865a199dc0fba636": {
6278 "model_module": "@jupyter-widgets/controls",
6279 "model_name": "ProgressStyleModel",
6280 "model_module_version": "1.5.0",
6281 "state": {
6282 "_model_module": "@jupyter-widgets/controls",
6283 "_model_module_version": "1.5.0",
6284 "_model_name": "ProgressStyleModel",
6285 "_view_count": null,
6286 "_view_module": "@jupyter-widgets/base",
6287 "_view_module_version": "1.2.0",
6288 "_view_name": "StyleView",
6289 "bar_color": null,
6290 "description_width": ""
6291 }
6292 },
6293 "e35861641d664e2ea8140ff988b65576": {
6294 "model_module": "@jupyter-widgets/base",
6295 "model_name": "LayoutModel",
6296 "model_module_version": "1.2.0",
6297 "state": {
6298 "_model_module": "@jupyter-widgets/base",
6299 "_model_module_version": "1.2.0",
6300 "_model_name": "LayoutModel",
6301 "_view_count": null,
6302 "_view_module": "@jupyter-widgets/base",
6303 "_view_module_version": "1.2.0",
6304 "_view_name": "LayoutView",
6305 "align_content": null,
6306 "align_items": null,
6307 "align_self": null,
6308 "border": null,
6309 "bottom": null,
6310 "display": null,
6311 "flex": null,
6312 "flex_flow": null,
6313 "grid_area": null,
6314 "grid_auto_columns": null,
6315 "grid_auto_flow": null,
6316 "grid_auto_rows": null,
6317 "grid_column": null,
6318 "grid_gap": null,
6319 "grid_row": null,
6320 "grid_template_areas": null,
6321 "grid_template_columns": null,
6322 "grid_template_rows": null,
6323 "height": null,
6324 "justify_content": null,
6325 "justify_items": null,
6326 "left": null,
6327 "margin": null,
6328 "max_height": null,
6329 "max_width": null,
6330 "min_height": null,
6331 "min_width": null,
6332 "object_fit": null,
6333 "object_position": null,
6334 "order": null,
6335 "overflow": null,
6336 "overflow_x": null,
6337 "overflow_y": null,
6338 "padding": null,
6339 "right": null,
6340 "top": null,
6341 "visibility": null,
6342 "width": null
6343 }
6344 },
6345 "4d683f5e6ccb4328bfd33829e05e2e35": {
6346 "model_module": "@jupyter-widgets/controls",
6347 "model_name": "DescriptionStyleModel",
6348 "model_module_version": "1.5.0",
6349 "state": {
6350 "_model_module": "@jupyter-widgets/controls",
6351 "_model_module_version": "1.5.0",
6352 "_model_name": "DescriptionStyleModel",
6353 "_view_count": null,
6354 "_view_module": "@jupyter-widgets/base",
6355 "_view_module_version": "1.2.0",
6356 "_view_name": "StyleView",
6357 "description_width": ""
6358 }
6359 },
6360 "8eb84c34c1a54dad903371885051bef2": {
6361 "model_module": "@jupyter-widgets/controls",
6362 "model_name": "HBoxModel",
6363 "model_module_version": "1.5.0",
6364 "state": {
6365 "_dom_classes": [],
6366 "_model_module": "@jupyter-widgets/controls",
6367 "_model_module_version": "1.5.0",
6368 "_model_name": "HBoxModel",
6369 "_view_count": null,
6370 "_view_module": "@jupyter-widgets/controls",
6371 "_view_module_version": "1.5.0",
6372 "_view_name": "HBoxView",
6373 "box_style": "",
6374 "children": [
6375 "IPY_MODEL_424d7efa1e1d4c79a5a9e1e0eea97bc3",
6376 "IPY_MODEL_0d6619a581884191a205c9e1b91b3790",
6377 "IPY_MODEL_035553232bbc40c789c35bdcd78d7b88"
6378 ],
6379 "layout": "IPY_MODEL_6648bcb6b46e4dc893654f139a7b73df"
6380 }
6381 },
6382 "424d7efa1e1d4c79a5a9e1e0eea97bc3": {
6383 "model_module": "@jupyter-widgets/controls",
6384 "model_name": "HTMLModel",
6385 "model_module_version": "1.5.0",
6386 "state": {
6387 "_dom_classes": [],
6388 "_model_module": "@jupyter-widgets/controls",
6389 "_model_module_version": "1.5.0",
6390 "_model_name": "HTMLModel",
6391 "_view_count": null,
6392 "_view_module": "@jupyter-widgets/controls",
6393 "_view_module_version": "1.5.0",
6394 "_view_name": "HTMLView",
6395 "description": "",
6396 "description_tooltip": null,
6397 "layout": "IPY_MODEL_d4302a261e334336b71459e74fee95a4",
6398 "placeholder": "​",
6399 "style": "IPY_MODEL_5ae44fb9f67b40bb8261defbc07bf689",
6400 "value": "Validation DataLoader 0: 100%"
6401 }
6402 },
6403 "0d6619a581884191a205c9e1b91b3790": {
6404 "model_module": "@jupyter-widgets/controls",
6405 "model_name": "FloatProgressModel",
6406 "model_module_version": "1.5.0",
6407 "state": {
6408 "_dom_classes": [],
6409 "_model_module": "@jupyter-widgets/controls",
6410 "_model_module_version": "1.5.0",
6411 "_model_name": "FloatProgressModel",
6412 "_view_count": null,
6413 "_view_module": "@jupyter-widgets/controls",
6414 "_view_module_version": "1.5.0",
6415 "_view_name": "ProgressView",
6416 "bar_style": "",
6417 "description": "",
6418 "description_tooltip": null,
6419 "layout": "IPY_MODEL_5097652e46cf4d1d88933903e37387dd",
6420 "max": 1,
6421 "min": 0,
6422 "orientation": "horizontal",
6423 "style": "IPY_MODEL_82e9918bb5b648058fe32b19b0ab7059",
6424 "value": 1
6425 }
6426 },
6427 "035553232bbc40c789c35bdcd78d7b88": {
6428 "model_module": "@jupyter-widgets/controls",
6429 "model_name": "HTMLModel",
6430 "model_module_version": "1.5.0",
6431 "state": {
6432 "_dom_classes": [],
6433 "_model_module": "@jupyter-widgets/controls",
6434 "_model_module_version": "1.5.0",
6435 "_model_name": "HTMLModel",
6436 "_view_count": null,
6437 "_view_module": "@jupyter-widgets/controls",
6438 "_view_module_version": "1.5.0",
6439 "_view_name": "HTMLView",
6440 "description": "",
6441 "description_tooltip": null,
6442 "layout": "IPY_MODEL_28913620d1dc406db67ff7876db5d414",
6443 "placeholder": "​",
6444 "style": "IPY_MODEL_2e5b502d9c0e47449a6e7b5095d5b6ec",
6445 "value": " 1/1 [00:00&lt;00:00, 91.51it/s]"
6446 }
6447 },
6448 "6648bcb6b46e4dc893654f139a7b73df": {
6449 "model_module": "@jupyter-widgets/base",
6450 "model_name": "LayoutModel",
6451 "model_module_version": "1.2.0",
6452 "state": {
6453 "_model_module": "@jupyter-widgets/base",
6454 "_model_module_version": "1.2.0",
6455 "_model_name": "LayoutModel",
6456 "_view_count": null,
6457 "_view_module": "@jupyter-widgets/base",
6458 "_view_module_version": "1.2.0",
6459 "_view_name": "LayoutView",
6460 "align_content": null,
6461 "align_items": null,
6462 "align_self": null,
6463 "border": null,
6464 "bottom": null,
6465 "display": "inline-flex",
6466 "flex": null,
6467 "flex_flow": "row wrap",
6468 "grid_area": null,
6469 "grid_auto_columns": null,
6470 "grid_auto_flow": null,
6471 "grid_auto_rows": null,
6472 "grid_column": null,
6473 "grid_gap": null,
6474 "grid_row": null,
6475 "grid_template_areas": null,
6476 "grid_template_columns": null,
6477 "grid_template_rows": null,
6478 "height": null,
6479 "justify_content": null,
6480 "justify_items": null,
6481 "left": null,
6482 "margin": null,
6483 "max_height": null,
6484 "max_width": null,
6485 "min_height": null,
6486 "min_width": null,
6487 "object_fit": null,
6488 "object_position": null,
6489 "order": null,
6490 "overflow": null,
6491 "overflow_x": null,
6492 "overflow_y": null,
6493 "padding": null,
6494 "right": null,
6495 "top": null,
6496 "visibility": null,
6497 "width": "100%"
6498 }
6499 },
6500 "d4302a261e334336b71459e74fee95a4": {
6501 "model_module": "@jupyter-widgets/base",
6502 "model_name": "LayoutModel",
6503 "model_module_version": "1.2.0",
6504 "state": {
6505 "_model_module": "@jupyter-widgets/base",
6506 "_model_module_version": "1.2.0",
6507 "_model_name": "LayoutModel",
6508 "_view_count": null,
6509 "_view_module": "@jupyter-widgets/base",
6510 "_view_module_version": "1.2.0",
6511 "_view_name": "LayoutView",
6512 "align_content": null,
6513 "align_items": null,
6514 "align_self": null,
6515 "border": null,
6516 "bottom": null,
6517 "display": null,
6518 "flex": null,
6519 "flex_flow": null,
6520 "grid_area": null,
6521 "grid_auto_columns": null,
6522 "grid_auto_flow": null,
6523 "grid_auto_rows": null,
6524 "grid_column": null,
6525 "grid_gap": null,
6526 "grid_row": null,
6527 "grid_template_areas": null,
6528 "grid_template_columns": null,
6529 "grid_template_rows": null,
6530 "height": null,
6531 "justify_content": null,
6532 "justify_items": null,
6533 "left": null,
6534 "margin": null,
6535 "max_height": null,
6536 "max_width": null,
6537 "min_height": null,
6538 "min_width": null,
6539 "object_fit": null,
6540 "object_position": null,
6541 "order": null,
6542 "overflow": null,
6543 "overflow_x": null,
6544 "overflow_y": null,
6545 "padding": null,
6546 "right": null,
6547 "top": null,
6548 "visibility": null,
6549 "width": null
6550 }
6551 },
6552 "5ae44fb9f67b40bb8261defbc07bf689": {
6553 "model_module": "@jupyter-widgets/controls",
6554 "model_name": "DescriptionStyleModel",
6555 "model_module_version": "1.5.0",
6556 "state": {
6557 "_model_module": "@jupyter-widgets/controls",
6558 "_model_module_version": "1.5.0",
6559 "_model_name": "DescriptionStyleModel",
6560 "_view_count": null,
6561 "_view_module": "@jupyter-widgets/base",
6562 "_view_module_version": "1.2.0",
6563 "_view_name": "StyleView",
6564 "description_width": ""
6565 }
6566 },
6567 "5097652e46cf4d1d88933903e37387dd": {
6568 "model_module": "@jupyter-widgets/base",
6569 "model_name": "LayoutModel",
6570 "model_module_version": "1.2.0",
6571 "state": {
6572 "_model_module": "@jupyter-widgets/base",
6573 "_model_module_version": "1.2.0",
6574 "_model_name": "LayoutModel",
6575 "_view_count": null,
6576 "_view_module": "@jupyter-widgets/base",
6577 "_view_module_version": "1.2.0",
6578 "_view_name": "LayoutView",
6579 "align_content": null,
6580 "align_items": null,
6581 "align_self": null,
6582 "border": null,
6583 "bottom": null,
6584 "display": null,
6585 "flex": "2",
6586 "flex_flow": null,
6587 "grid_area": null,
6588 "grid_auto_columns": null,
6589 "grid_auto_flow": null,
6590 "grid_auto_rows": null,
6591 "grid_column": null,
6592 "grid_gap": null,
6593 "grid_row": null,
6594 "grid_template_areas": null,
6595 "grid_template_columns": null,
6596 "grid_template_rows": null,
6597 "height": null,
6598 "justify_content": null,
6599 "justify_items": null,
6600 "left": null,
6601 "margin": null,
6602 "max_height": null,
6603 "max_width": null,
6604 "min_height": null,
6605 "min_width": null,
6606 "object_fit": null,
6607 "object_position": null,
6608 "order": null,
6609 "overflow": null,
6610 "overflow_x": null,
6611 "overflow_y": null,
6612 "padding": null,
6613 "right": null,
6614 "top": null,
6615 "visibility": null,
6616 "width": null
6617 }
6618 },
6619 "82e9918bb5b648058fe32b19b0ab7059": {
6620 "model_module": "@jupyter-widgets/controls",
6621 "model_name": "ProgressStyleModel",
6622 "model_module_version": "1.5.0",
6623 "state": {
6624 "_model_module": "@jupyter-widgets/controls",
6625 "_model_module_version": "1.5.0",
6626 "_model_name": "ProgressStyleModel",
6627 "_view_count": null,
6628 "_view_module": "@jupyter-widgets/base",
6629 "_view_module_version": "1.2.0",
6630 "_view_name": "StyleView",
6631 "bar_color": null,
6632 "description_width": ""
6633 }
6634 },
6635 "28913620d1dc406db67ff7876db5d414": {
6636 "model_module": "@jupyter-widgets/base",
6637 "model_name": "LayoutModel",
6638 "model_module_version": "1.2.0",
6639 "state": {
6640 "_model_module": "@jupyter-widgets/base",
6641 "_model_module_version": "1.2.0",
6642 "_model_name": "LayoutModel",
6643 "_view_count": null,
6644 "_view_module": "@jupyter-widgets/base",
6645 "_view_module_version": "1.2.0",
6646 "_view_name": "LayoutView",
6647 "align_content": null,
6648 "align_items": null,
6649 "align_self": null,
6650 "border": null,
6651 "bottom": null,
6652 "display": null,
6653 "flex": null,
6654 "flex_flow": null,
6655 "grid_area": null,
6656 "grid_auto_columns": null,
6657 "grid_auto_flow": null,
6658 "grid_auto_rows": null,
6659 "grid_column": null,
6660 "grid_gap": null,
6661 "grid_row": null,
6662 "grid_template_areas": null,
6663 "grid_template_columns": null,
6664 "grid_template_rows": null,
6665 "height": null,
6666 "justify_content": null,
6667 "justify_items": null,
6668 "left": null,
6669 "margin": null,
6670 "max_height": null,
6671 "max_width": null,
6672 "min_height": null,
6673 "min_width": null,
6674 "object_fit": null,
6675 "object_position": null,
6676 "order": null,
6677 "overflow": null,
6678 "overflow_x": null,
6679 "overflow_y": null,
6680 "padding": null,
6681 "right": null,
6682 "top": null,
6683 "visibility": null,
6684 "width": null
6685 }
6686 },
6687 "2e5b502d9c0e47449a6e7b5095d5b6ec": {
6688 "model_module": "@jupyter-widgets/controls",
6689 "model_name": "DescriptionStyleModel",
6690 "model_module_version": "1.5.0",
6691 "state": {
6692 "_model_module": "@jupyter-widgets/controls",
6693 "_model_module_version": "1.5.0",
6694 "_model_name": "DescriptionStyleModel",
6695 "_view_count": null,
6696 "_view_module": "@jupyter-widgets/base",
6697 "_view_module_version": "1.2.0",
6698 "_view_name": "StyleView",
6699 "description_width": ""
6700 }
6701 },
6702 "044439bda84b4d24935a46be5c14ca02": {
6703 "model_module": "@jupyter-widgets/controls",
6704 "model_name": "HBoxModel",
6705 "model_module_version": "1.5.0",
6706 "state": {
6707 "_dom_classes": [],
6708 "_model_module": "@jupyter-widgets/controls",
6709 "_model_module_version": "1.5.0",
6710 "_model_name": "HBoxModel",
6711 "_view_count": null,
6712 "_view_module": "@jupyter-widgets/controls",
6713 "_view_module_version": "1.5.0",
6714 "_view_name": "HBoxView",
6715 "box_style": "",
6716 "children": [
6717 "IPY_MODEL_3aa9793c2771435b892c70a5ca86a372",
6718 "IPY_MODEL_490c7d65abaf46a1a6f781395f846b83",
6719 "IPY_MODEL_b3ad1dfdecf649988c4060e76f0c9164"
6720 ],
6721 "layout": "IPY_MODEL_6f0bd0ab209348d2a76ae70cfbfa47ff"
6722 }
6723 },
6724 "3aa9793c2771435b892c70a5ca86a372": {
6725 "model_module": "@jupyter-widgets/controls",
6726 "model_name": "HTMLModel",
6727 "model_module_version": "1.5.0",
6728 "state": {
6729 "_dom_classes": [],
6730 "_model_module": "@jupyter-widgets/controls",
6731 "_model_module_version": "1.5.0",
6732 "_model_name": "HTMLModel",
6733 "_view_count": null,
6734 "_view_module": "@jupyter-widgets/controls",
6735 "_view_module_version": "1.5.0",
6736 "_view_name": "HTMLView",
6737 "description": "",
6738 "description_tooltip": null,
6739 "layout": "IPY_MODEL_95dc3afa44174e9f8e715dab0a3dfd7d",
6740 "placeholder": "​",
6741 "style": "IPY_MODEL_d2f7362dee2b4100930a7a1f288e649e",
6742 "value": "Validation DataLoader 0: 100%"
6743 }
6744 },
6745 "490c7d65abaf46a1a6f781395f846b83": {
6746 "model_module": "@jupyter-widgets/controls",
6747 "model_name": "FloatProgressModel",
6748 "model_module_version": "1.5.0",
6749 "state": {
6750 "_dom_classes": [],
6751 "_model_module": "@jupyter-widgets/controls",
6752 "_model_module_version": "1.5.0",
6753 "_model_name": "FloatProgressModel",
6754 "_view_count": null,
6755 "_view_module": "@jupyter-widgets/controls",
6756 "_view_module_version": "1.5.0",
6757 "_view_name": "ProgressView",
6758 "bar_style": "",
6759 "description": "",
6760 "description_tooltip": null,
6761 "layout": "IPY_MODEL_c92364fa157f4212a9a9811925605382",
6762 "max": 1,
6763 "min": 0,
6764 "orientation": "horizontal",
6765 "style": "IPY_MODEL_aec5035eeab04627b3d61c05bf53ef4f",
6766 "value": 1
6767 }
6768 },
6769 "b3ad1dfdecf649988c4060e76f0c9164": {
6770 "model_module": "@jupyter-widgets/controls",
6771 "model_name": "HTMLModel",
6772 "model_module_version": "1.5.0",
6773 "state": {
6774 "_dom_classes": [],
6775 "_model_module": "@jupyter-widgets/controls",
6776 "_model_module_version": "1.5.0",
6777 "_model_name": "HTMLModel",
6778 "_view_count": null,
6779 "_view_module": "@jupyter-widgets/controls",
6780 "_view_module_version": "1.5.0",
6781 "_view_name": "HTMLView",
6782 "description": "",
6783 "description_tooltip": null,
6784 "layout": "IPY_MODEL_035f91d8fd1d4ff6932f9d01aa334f3a",
6785 "placeholder": "​",
6786 "style": "IPY_MODEL_8a56ba2f8d384c0fb285ac9cf7b5e421",
6787 "value": " 1/1 [00:00&lt;00:00, 98.04it/s]"
6788 }
6789 },
6790 "6f0bd0ab209348d2a76ae70cfbfa47ff": {
6791 "model_module": "@jupyter-widgets/base",
6792 "model_name": "LayoutModel",
6793 "model_module_version": "1.2.0",
6794 "state": {
6795 "_model_module": "@jupyter-widgets/base",
6796 "_model_module_version": "1.2.0",
6797 "_model_name": "LayoutModel",
6798 "_view_count": null,
6799 "_view_module": "@jupyter-widgets/base",
6800 "_view_module_version": "1.2.0",
6801 "_view_name": "LayoutView",
6802 "align_content": null,
6803 "align_items": null,
6804 "align_self": null,
6805 "border": null,
6806 "bottom": null,
6807 "display": "inline-flex",
6808 "flex": null,
6809 "flex_flow": "row wrap",
6810 "grid_area": null,
6811 "grid_auto_columns": null,
6812 "grid_auto_flow": null,
6813 "grid_auto_rows": null,
6814 "grid_column": null,
6815 "grid_gap": null,
6816 "grid_row": null,
6817 "grid_template_areas": null,
6818 "grid_template_columns": null,
6819 "grid_template_rows": null,
6820 "height": null,
6821 "justify_content": null,
6822 "justify_items": null,
6823 "left": null,
6824 "margin": null,
6825 "max_height": null,
6826 "max_width": null,
6827 "min_height": null,
6828 "min_width": null,
6829 "object_fit": null,
6830 "object_position": null,
6831 "order": null,
6832 "overflow": null,
6833 "overflow_x": null,
6834 "overflow_y": null,
6835 "padding": null,
6836 "right": null,
6837 "top": null,
6838 "visibility": null,
6839 "width": "100%"
6840 }
6841 },
6842 "95dc3afa44174e9f8e715dab0a3dfd7d": {
6843 "model_module": "@jupyter-widgets/base",
6844 "model_name": "LayoutModel",
6845 "model_module_version": "1.2.0",
6846 "state": {
6847 "_model_module": "@jupyter-widgets/base",
6848 "_model_module_version": "1.2.0",
6849 "_model_name": "LayoutModel",
6850 "_view_count": null,
6851 "_view_module": "@jupyter-widgets/base",
6852 "_view_module_version": "1.2.0",
6853 "_view_name": "LayoutView",
6854 "align_content": null,
6855 "align_items": null,
6856 "align_self": null,
6857 "border": null,
6858 "bottom": null,
6859 "display": null,
6860 "flex": null,
6861 "flex_flow": null,
6862 "grid_area": null,
6863 "grid_auto_columns": null,
6864 "grid_auto_flow": null,
6865 "grid_auto_rows": null,
6866 "grid_column": null,
6867 "grid_gap": null,
6868 "grid_row": null,
6869 "grid_template_areas": null,
6870 "grid_template_columns": null,
6871 "grid_template_rows": null,
6872 "height": null,
6873 "justify_content": null,
6874 "justify_items": null,
6875 "left": null,
6876 "margin": null,
6877 "max_height": null,
6878 "max_width": null,
6879 "min_height": null,
6880 "min_width": null,
6881 "object_fit": null,
6882 "object_position": null,
6883 "order": null,
6884 "overflow": null,
6885 "overflow_x": null,
6886 "overflow_y": null,
6887 "padding": null,
6888 "right": null,
6889 "top": null,
6890 "visibility": null,
6891 "width": null
6892 }
6893 },
6894 "d2f7362dee2b4100930a7a1f288e649e": {
6895 "model_module": "@jupyter-widgets/controls",
6896 "model_name": "DescriptionStyleModel",
6897 "model_module_version": "1.5.0",
6898 "state": {
6899 "_model_module": "@jupyter-widgets/controls",
6900 "_model_module_version": "1.5.0",
6901 "_model_name": "DescriptionStyleModel",
6902 "_view_count": null,
6903 "_view_module": "@jupyter-widgets/base",
6904 "_view_module_version": "1.2.0",
6905 "_view_name": "StyleView",
6906 "description_width": ""
6907 }
6908 },
6909 "c92364fa157f4212a9a9811925605382": {
6910 "model_module": "@jupyter-widgets/base",
6911 "model_name": "LayoutModel",
6912 "model_module_version": "1.2.0",
6913 "state": {
6914 "_model_module": "@jupyter-widgets/base",
6915 "_model_module_version": "1.2.0",
6916 "_model_name": "LayoutModel",
6917 "_view_count": null,
6918 "_view_module": "@jupyter-widgets/base",
6919 "_view_module_version": "1.2.0",
6920 "_view_name": "LayoutView",
6921 "align_content": null,
6922 "align_items": null,
6923 "align_self": null,
6924 "border": null,
6925 "bottom": null,
6926 "display": null,
6927 "flex": "2",
6928 "flex_flow": null,
6929 "grid_area": null,
6930 "grid_auto_columns": null,
6931 "grid_auto_flow": null,
6932 "grid_auto_rows": null,
6933 "grid_column": null,
6934 "grid_gap": null,
6935 "grid_row": null,
6936 "grid_template_areas": null,
6937 "grid_template_columns": null,
6938 "grid_template_rows": null,
6939 "height": null,
6940 "justify_content": null,
6941 "justify_items": null,
6942 "left": null,
6943 "margin": null,
6944 "max_height": null,
6945 "max_width": null,
6946 "min_height": null,
6947 "min_width": null,
6948 "object_fit": null,
6949 "object_position": null,
6950 "order": null,
6951 "overflow": null,
6952 "overflow_x": null,
6953 "overflow_y": null,
6954 "padding": null,
6955 "right": null,
6956 "top": null,
6957 "visibility": null,
6958 "width": null
6959 }
6960 },
6961 "aec5035eeab04627b3d61c05bf53ef4f": {
6962 "model_module": "@jupyter-widgets/controls",
6963 "model_name": "ProgressStyleModel",
6964 "model_module_version": "1.5.0",
6965 "state": {
6966 "_model_module": "@jupyter-widgets/controls",
6967 "_model_module_version": "1.5.0",
6968 "_model_name": "ProgressStyleModel",
6969 "_view_count": null,
6970 "_view_module": "@jupyter-widgets/base",
6971 "_view_module_version": "1.2.0",
6972 "_view_name": "StyleView",
6973 "bar_color": null,
6974 "description_width": ""
6975 }
6976 },
6977 "035f91d8fd1d4ff6932f9d01aa334f3a": {
6978 "model_module": "@jupyter-widgets/base",
6979 "model_name": "LayoutModel",
6980 "model_module_version": "1.2.0",
6981 "state": {
6982 "_model_module": "@jupyter-widgets/base",
6983 "_model_module_version": "1.2.0",
6984 "_model_name": "LayoutModel",
6985 "_view_count": null,
6986 "_view_module": "@jupyter-widgets/base",
6987 "_view_module_version": "1.2.0",
6988 "_view_name": "LayoutView",
6989 "align_content": null,
6990 "align_items": null,
6991 "align_self": null,
6992 "border": null,
6993 "bottom": null,
6994 "display": null,
6995 "flex": null,
6996 "flex_flow": null,
6997 "grid_area": null,
6998 "grid_auto_columns": null,
6999 "grid_auto_flow": null,
7000 "grid_auto_rows": null,
7001 "grid_column": null,
7002 "grid_gap": null,
7003 "grid_row": null,
7004 "grid_template_areas": null,
7005 "grid_template_columns": null,
7006 "grid_template_rows": null,
7007 "height": null,
7008 "justify_content": null,
7009 "justify_items": null,
7010 "left": null,
7011 "margin": null,
7012 "max_height": null,
7013 "max_width": null,
7014 "min_height": null,
7015 "min_width": null,
7016 "object_fit": null,
7017 "object_position": null,
7018 "order": null,
7019 "overflow": null,
7020 "overflow_x": null,
7021 "overflow_y": null,
7022 "padding": null,
7023 "right": null,
7024 "top": null,
7025 "visibility": null,
7026 "width": null
7027 }
7028 },
7029 "8a56ba2f8d384c0fb285ac9cf7b5e421": {
7030 "model_module": "@jupyter-widgets/controls",
7031 "model_name": "DescriptionStyleModel",
7032 "model_module_version": "1.5.0",
7033 "state": {
7034 "_model_module": "@jupyter-widgets/controls",
7035 "_model_module_version": "1.5.0",
7036 "_model_name": "DescriptionStyleModel",
7037 "_view_count": null,
7038 "_view_module": "@jupyter-widgets/base",
7039 "_view_module_version": "1.2.0",
7040 "_view_name": "StyleView",
7041 "description_width": ""
7042 }
7043 },
7044 "675520bc1a7e4aca9e17f7410d6380cf": {
7045 "model_module": "@jupyter-widgets/controls",
7046 "model_name": "HBoxModel",
7047 "model_module_version": "1.5.0",
7048 "state": {
7049 "_dom_classes": [],
7050 "_model_module": "@jupyter-widgets/controls",
7051 "_model_module_version": "1.5.0",
7052 "_model_name": "HBoxModel",
7053 "_view_count": null,
7054 "_view_module": "@jupyter-widgets/controls",
7055 "_view_module_version": "1.5.0",
7056 "_view_name": "HBoxView",
7057 "box_style": "",
7058 "children": [
7059 "IPY_MODEL_9b19f80d8f5648b9b575515d2f8085f8",
7060 "IPY_MODEL_c0065e721652472996f40eb47071589c",
7061 "IPY_MODEL_b236adc069d049c288d81702cc0dd62c"
7062 ],
7063 "layout": "IPY_MODEL_5eefa033732941b39bf3bfa62fd9185e"
7064 }
7065 },
7066 "9b19f80d8f5648b9b575515d2f8085f8": {
7067 "model_module": "@jupyter-widgets/controls",
7068 "model_name": "HTMLModel",
7069 "model_module_version": "1.5.0",
7070 "state": {
7071 "_dom_classes": [],
7072 "_model_module": "@jupyter-widgets/controls",
7073 "_model_module_version": "1.5.0",
7074 "_model_name": "HTMLModel",
7075 "_view_count": null,
7076 "_view_module": "@jupyter-widgets/controls",
7077 "_view_module_version": "1.5.0",
7078 "_view_name": "HTMLView",
7079 "description": "",
7080 "description_tooltip": null,
7081 "layout": "IPY_MODEL_5aefc7d586ae4be4aa33c1383f494b9f",
7082 "placeholder": "​",
7083 "style": "IPY_MODEL_5e0c000321a64c28a81a1e167d88bd22",
7084 "value": "Validation DataLoader 0: 100%"
7085 }
7086 },
7087 "c0065e721652472996f40eb47071589c": {
7088 "model_module": "@jupyter-widgets/controls",
7089 "model_name": "FloatProgressModel",
7090 "model_module_version": "1.5.0",
7091 "state": {
7092 "_dom_classes": [],
7093 "_model_module": "@jupyter-widgets/controls",
7094 "_model_module_version": "1.5.0",
7095 "_model_name": "FloatProgressModel",
7096 "_view_count": null,
7097 "_view_module": "@jupyter-widgets/controls",
7098 "_view_module_version": "1.5.0",
7099 "_view_name": "ProgressView",
7100 "bar_style": "",
7101 "description": "",
7102 "description_tooltip": null,
7103 "layout": "IPY_MODEL_438661c89c034656b86e936360474b24",
7104 "max": 1,
7105 "min": 0,
7106 "orientation": "horizontal",
7107 "style": "IPY_MODEL_ed1fca3c73ad446db422e30f5ec44b0e",
7108 "value": 1
7109 }
7110 },
7111 "b236adc069d049c288d81702cc0dd62c": {
7112 "model_module": "@jupyter-widgets/controls",
7113 "model_name": "HTMLModel",
7114 "model_module_version": "1.5.0",
7115 "state": {
7116 "_dom_classes": [],
7117 "_model_module": "@jupyter-widgets/controls",
7118 "_model_module_version": "1.5.0",
7119 "_model_name": "HTMLModel",
7120 "_view_count": null,
7121 "_view_module": "@jupyter-widgets/controls",
7122 "_view_module_version": "1.5.0",
7123 "_view_name": "HTMLView",
7124 "description": "",
7125 "description_tooltip": null,
7126 "layout": "IPY_MODEL_4421eb7516c04af1972c6f5df5315bc4",
7127 "placeholder": "​",
7128 "style": "IPY_MODEL_6d52bfaf6be54d90a53e1fb465dfaf7d",
7129 "value": " 1/1 [00:00&lt;00:00, 85.71it/s]"
7130 }
7131 },
7132 "5eefa033732941b39bf3bfa62fd9185e": {
7133 "model_module": "@jupyter-widgets/base",
7134 "model_name": "LayoutModel",
7135 "model_module_version": "1.2.0",
7136 "state": {
7137 "_model_module": "@jupyter-widgets/base",
7138 "_model_module_version": "1.2.0",
7139 "_model_name": "LayoutModel",
7140 "_view_count": null,
7141 "_view_module": "@jupyter-widgets/base",
7142 "_view_module_version": "1.2.0",
7143 "_view_name": "LayoutView",
7144 "align_content": null,
7145 "align_items": null,
7146 "align_self": null,
7147 "border": null,
7148 "bottom": null,
7149 "display": "inline-flex",
7150 "flex": null,
7151 "flex_flow": "row wrap",
7152 "grid_area": null,
7153 "grid_auto_columns": null,
7154 "grid_auto_flow": null,
7155 "grid_auto_rows": null,
7156 "grid_column": null,
7157 "grid_gap": null,
7158 "grid_row": null,
7159 "grid_template_areas": null,
7160 "grid_template_columns": null,
7161 "grid_template_rows": null,
7162 "height": null,
7163 "justify_content": null,
7164 "justify_items": null,
7165 "left": null,
7166 "margin": null,
7167 "max_height": null,
7168 "max_width": null,
7169 "min_height": null,
7170 "min_width": null,
7171 "object_fit": null,
7172 "object_position": null,
7173 "order": null,
7174 "overflow": null,
7175 "overflow_x": null,
7176 "overflow_y": null,
7177 "padding": null,
7178 "right": null,
7179 "top": null,
7180 "visibility": null,
7181 "width": "100%"
7182 }
7183 },
7184 "5aefc7d586ae4be4aa33c1383f494b9f": {
7185 "model_module": "@jupyter-widgets/base",
7186 "model_name": "LayoutModel",
7187 "model_module_version": "1.2.0",
7188 "state": {
7189 "_model_module": "@jupyter-widgets/base",
7190 "_model_module_version": "1.2.0",
7191 "_model_name": "LayoutModel",
7192 "_view_count": null,
7193 "_view_module": "@jupyter-widgets/base",
7194 "_view_module_version": "1.2.0",
7195 "_view_name": "LayoutView",
7196 "align_content": null,
7197 "align_items": null,
7198 "align_self": null,
7199 "border": null,
7200 "bottom": null,
7201 "display": null,
7202 "flex": null,
7203 "flex_flow": null,
7204 "grid_area": null,
7205 "grid_auto_columns": null,
7206 "grid_auto_flow": null,
7207 "grid_auto_rows": null,
7208 "grid_column": null,
7209 "grid_gap": null,
7210 "grid_row": null,
7211 "grid_template_areas": null,
7212 "grid_template_columns": null,
7213 "grid_template_rows": null,
7214 "height": null,
7215 "justify_content": null,
7216 "justify_items": null,
7217 "left": null,
7218 "margin": null,
7219 "max_height": null,
7220 "max_width": null,
7221 "min_height": null,
7222 "min_width": null,
7223 "object_fit": null,
7224 "object_position": null,
7225 "order": null,
7226 "overflow": null,
7227 "overflow_x": null,
7228 "overflow_y": null,
7229 "padding": null,
7230 "right": null,
7231 "top": null,
7232 "visibility": null,
7233 "width": null
7234 }
7235 },
7236 "5e0c000321a64c28a81a1e167d88bd22": {
7237 "model_module": "@jupyter-widgets/controls",
7238 "model_name": "DescriptionStyleModel",
7239 "model_module_version": "1.5.0",
7240 "state": {
7241 "_model_module": "@jupyter-widgets/controls",
7242 "_model_module_version": "1.5.0",
7243 "_model_name": "DescriptionStyleModel",
7244 "_view_count": null,
7245 "_view_module": "@jupyter-widgets/base",
7246 "_view_module_version": "1.2.0",
7247 "_view_name": "StyleView",
7248 "description_width": ""
7249 }
7250 },
7251 "438661c89c034656b86e936360474b24": {
7252 "model_module": "@jupyter-widgets/base",
7253 "model_name": "LayoutModel",
7254 "model_module_version": "1.2.0",
7255 "state": {
7256 "_model_module": "@jupyter-widgets/base",
7257 "_model_module_version": "1.2.0",
7258 "_model_name": "LayoutModel",
7259 "_view_count": null,
7260 "_view_module": "@jupyter-widgets/base",
7261 "_view_module_version": "1.2.0",
7262 "_view_name": "LayoutView",
7263 "align_content": null,
7264 "align_items": null,
7265 "align_self": null,
7266 "border": null,
7267 "bottom": null,
7268 "display": null,
7269 "flex": "2",
7270 "flex_flow": null,
7271 "grid_area": null,
7272 "grid_auto_columns": null,
7273 "grid_auto_flow": null,
7274 "grid_auto_rows": null,
7275 "grid_column": null,
7276 "grid_gap": null,
7277 "grid_row": null,
7278 "grid_template_areas": null,
7279 "grid_template_columns": null,
7280 "grid_template_rows": null,
7281 "height": null,
7282 "justify_content": null,
7283 "justify_items": null,
7284 "left": null,
7285 "margin": null,
7286 "max_height": null,
7287 "max_width": null,
7288 "min_height": null,
7289 "min_width": null,
7290 "object_fit": null,
7291 "object_position": null,
7292 "order": null,
7293 "overflow": null,
7294 "overflow_x": null,
7295 "overflow_y": null,
7296 "padding": null,
7297 "right": null,
7298 "top": null,
7299 "visibility": null,
7300 "width": null
7301 }
7302 },
7303 "ed1fca3c73ad446db422e30f5ec44b0e": {
7304 "model_module": "@jupyter-widgets/controls",
7305 "model_name": "ProgressStyleModel",
7306 "model_module_version": "1.5.0",
7307 "state": {
7308 "_model_module": "@jupyter-widgets/controls",
7309 "_model_module_version": "1.5.0",
7310 "_model_name": "ProgressStyleModel",
7311 "_view_count": null,
7312 "_view_module": "@jupyter-widgets/base",
7313 "_view_module_version": "1.2.0",
7314 "_view_name": "StyleView",
7315 "bar_color": null,
7316 "description_width": ""
7317 }
7318 },
7319 "4421eb7516c04af1972c6f5df5315bc4": {
7320 "model_module": "@jupyter-widgets/base",
7321 "model_name": "LayoutModel",
7322 "model_module_version": "1.2.0",
7323 "state": {
7324 "_model_module": "@jupyter-widgets/base",
7325 "_model_module_version": "1.2.0",
7326 "_model_name": "LayoutModel",
7327 "_view_count": null,
7328 "_view_module": "@jupyter-widgets/base",
7329 "_view_module_version": "1.2.0",
7330 "_view_name": "LayoutView",
7331 "align_content": null,
7332 "align_items": null,
7333 "align_self": null,
7334 "border": null,
7335 "bottom": null,
7336 "display": null,
7337 "flex": null,
7338 "flex_flow": null,
7339 "grid_area": null,
7340 "grid_auto_columns": null,
7341 "grid_auto_flow": null,
7342 "grid_auto_rows": null,
7343 "grid_column": null,
7344 "grid_gap": null,
7345 "grid_row": null,
7346 "grid_template_areas": null,
7347 "grid_template_columns": null,
7348 "grid_template_rows": null,
7349 "height": null,
7350 "justify_content": null,
7351 "justify_items": null,
7352 "left": null,
7353 "margin": null,
7354 "max_height": null,
7355 "max_width": null,
7356 "min_height": null,
7357 "min_width": null,
7358 "object_fit": null,
7359 "object_position": null,
7360 "order": null,
7361 "overflow": null,
7362 "overflow_x": null,
7363 "overflow_y": null,
7364 "padding": null,
7365 "right": null,
7366 "top": null,
7367 "visibility": null,
7368 "width": null
7369 }
7370 },
7371 "6d52bfaf6be54d90a53e1fb465dfaf7d": {
7372 "model_module": "@jupyter-widgets/controls",
7373 "model_name": "DescriptionStyleModel",
7374 "model_module_version": "1.5.0",
7375 "state": {
7376 "_model_module": "@jupyter-widgets/controls",
7377 "_model_module_version": "1.5.0",
7378 "_model_name": "DescriptionStyleModel",
7379 "_view_count": null,
7380 "_view_module": "@jupyter-widgets/base",
7381 "_view_module_version": "1.2.0",
7382 "_view_name": "StyleView",
7383 "description_width": ""
7384 }
7385 },
7386 "3cd65d1d3cd0438ea94b8c4d964bc65c": {
7387 "model_module": "@jupyter-widgets/controls",
7388 "model_name": "HBoxModel",
7389 "model_module_version": "1.5.0",
7390 "state": {
7391 "_dom_classes": [],
7392 "_model_module": "@jupyter-widgets/controls",
7393 "_model_module_version": "1.5.0",
7394 "_model_name": "HBoxModel",
7395 "_view_count": null,
7396 "_view_module": "@jupyter-widgets/controls",
7397 "_view_module_version": "1.5.0",
7398 "_view_name": "HBoxView",
7399 "box_style": "",
7400 "children": [
7401 "IPY_MODEL_a4653a04856c47a0b1907d864e3f1a15",
7402 "IPY_MODEL_02e9029cbe8a4db0b6ef00c4df0ae302",
7403 "IPY_MODEL_258629893fa14d178577ee19efdff31e"
7404 ],
7405 "layout": "IPY_MODEL_fe82872822b749ae87fac7eb4df0791e"
7406 }
7407 },
7408 "a4653a04856c47a0b1907d864e3f1a15": {
7409 "model_module": "@jupyter-widgets/controls",
7410 "model_name": "HTMLModel",
7411 "model_module_version": "1.5.0",
7412 "state": {
7413 "_dom_classes": [],
7414 "_model_module": "@jupyter-widgets/controls",
7415 "_model_module_version": "1.5.0",
7416 "_model_name": "HTMLModel",
7417 "_view_count": null,
7418 "_view_module": "@jupyter-widgets/controls",
7419 "_view_module_version": "1.5.0",
7420 "_view_name": "HTMLView",
7421 "description": "",
7422 "description_tooltip": null,
7423 "layout": "IPY_MODEL_07655ba9152647df80ad1efe4b117135",
7424 "placeholder": "​",
7425 "style": "IPY_MODEL_b6e87d03766a4185ad2c4d716aa456d7",
7426 "value": "Validation DataLoader 0: 100%"
7427 }
7428 },
7429 "02e9029cbe8a4db0b6ef00c4df0ae302": {
7430 "model_module": "@jupyter-widgets/controls",
7431 "model_name": "FloatProgressModel",
7432 "model_module_version": "1.5.0",
7433 "state": {
7434 "_dom_classes": [],
7435 "_model_module": "@jupyter-widgets/controls",
7436 "_model_module_version": "1.5.0",
7437 "_model_name": "FloatProgressModel",
7438 "_view_count": null,
7439 "_view_module": "@jupyter-widgets/controls",
7440 "_view_module_version": "1.5.0",
7441 "_view_name": "ProgressView",
7442 "bar_style": "",
7443 "description": "",
7444 "description_tooltip": null,
7445 "layout": "IPY_MODEL_c6f304a0747d40fea9571f99f5289986",
7446 "max": 1,
7447 "min": 0,
7448 "orientation": "horizontal",
7449 "style": "IPY_MODEL_5722085f090c4851a1cde4daf7db77df",
7450 "value": 1
7451 }
7452 },
7453 "258629893fa14d178577ee19efdff31e": {
7454 "model_module": "@jupyter-widgets/controls",
7455 "model_name": "HTMLModel",
7456 "model_module_version": "1.5.0",
7457 "state": {
7458 "_dom_classes": [],
7459 "_model_module": "@jupyter-widgets/controls",
7460 "_model_module_version": "1.5.0",
7461 "_model_name": "HTMLModel",
7462 "_view_count": null,
7463 "_view_module": "@jupyter-widgets/controls",
7464 "_view_module_version": "1.5.0",
7465 "_view_name": "HTMLView",
7466 "description": "",
7467 "description_tooltip": null,
7468 "layout": "IPY_MODEL_7aed32af8b134b56a041ebb25c32640c",
7469 "placeholder": "​",
7470 "style": "IPY_MODEL_a723ce7408e14b63b6d4311051dca322",
7471 "value": " 1/1 [00:00&lt;00:00, 127.66it/s]"
7472 }
7473 },
7474 "fe82872822b749ae87fac7eb4df0791e": {
7475 "model_module": "@jupyter-widgets/base",
7476 "model_name": "LayoutModel",
7477 "model_module_version": "1.2.0",
7478 "state": {
7479 "_model_module": "@jupyter-widgets/base",
7480 "_model_module_version": "1.2.0",
7481 "_model_name": "LayoutModel",
7482 "_view_count": null,
7483 "_view_module": "@jupyter-widgets/base",
7484 "_view_module_version": "1.2.0",
7485 "_view_name": "LayoutView",
7486 "align_content": null,
7487 "align_items": null,
7488 "align_self": null,
7489 "border": null,
7490 "bottom": null,
7491 "display": "inline-flex",
7492 "flex": null,
7493 "flex_flow": "row wrap",
7494 "grid_area": null,
7495 "grid_auto_columns": null,
7496 "grid_auto_flow": null,
7497 "grid_auto_rows": null,
7498 "grid_column": null,
7499 "grid_gap": null,
7500 "grid_row": null,
7501 "grid_template_areas": null,
7502 "grid_template_columns": null,
7503 "grid_template_rows": null,
7504 "height": null,
7505 "justify_content": null,
7506 "justify_items": null,
7507 "left": null,
7508 "margin": null,
7509 "max_height": null,
7510 "max_width": null,
7511 "min_height": null,
7512 "min_width": null,
7513 "object_fit": null,
7514 "object_position": null,
7515 "order": null,
7516 "overflow": null,
7517 "overflow_x": null,
7518 "overflow_y": null,
7519 "padding": null,
7520 "right": null,
7521 "top": null,
7522 "visibility": null,
7523 "width": "100%"
7524 }
7525 },
7526 "07655ba9152647df80ad1efe4b117135": {
7527 "model_module": "@jupyter-widgets/base",
7528 "model_name": "LayoutModel",
7529 "model_module_version": "1.2.0",
7530 "state": {
7531 "_model_module": "@jupyter-widgets/base",
7532 "_model_module_version": "1.2.0",
7533 "_model_name": "LayoutModel",
7534 "_view_count": null,
7535 "_view_module": "@jupyter-widgets/base",
7536 "_view_module_version": "1.2.0",
7537 "_view_name": "LayoutView",
7538 "align_content": null,
7539 "align_items": null,
7540 "align_self": null,
7541 "border": null,
7542 "bottom": null,
7543 "display": null,
7544 "flex": null,
7545 "flex_flow": null,
7546 "grid_area": null,
7547 "grid_auto_columns": null,
7548 "grid_auto_flow": null,
7549 "grid_auto_rows": null,
7550 "grid_column": null,
7551 "grid_gap": null,
7552 "grid_row": null,
7553 "grid_template_areas": null,
7554 "grid_template_columns": null,
7555 "grid_template_rows": null,
7556 "height": null,
7557 "justify_content": null,
7558 "justify_items": null,
7559 "left": null,
7560 "margin": null,
7561 "max_height": null,
7562 "max_width": null,
7563 "min_height": null,
7564 "min_width": null,
7565 "object_fit": null,
7566 "object_position": null,
7567 "order": null,
7568 "overflow": null,
7569 "overflow_x": null,
7570 "overflow_y": null,
7571 "padding": null,
7572 "right": null,
7573 "top": null,
7574 "visibility": null,
7575 "width": null
7576 }
7577 },
7578 "b6e87d03766a4185ad2c4d716aa456d7": {
7579 "model_module": "@jupyter-widgets/controls",
7580 "model_name": "DescriptionStyleModel",
7581 "model_module_version": "1.5.0",
7582 "state": {
7583 "_model_module": "@jupyter-widgets/controls",
7584 "_model_module_version": "1.5.0",
7585 "_model_name": "DescriptionStyleModel",
7586 "_view_count": null,
7587 "_view_module": "@jupyter-widgets/base",
7588 "_view_module_version": "1.2.0",
7589 "_view_name": "StyleView",
7590 "description_width": ""
7591 }
7592 },
7593 "c6f304a0747d40fea9571f99f5289986": {
7594 "model_module": "@jupyter-widgets/base",
7595 "model_name": "LayoutModel",
7596 "model_module_version": "1.2.0",
7597 "state": {
7598 "_model_module": "@jupyter-widgets/base",
7599 "_model_module_version": "1.2.0",
7600 "_model_name": "LayoutModel",
7601 "_view_count": null,
7602 "_view_module": "@jupyter-widgets/base",
7603 "_view_module_version": "1.2.0",
7604 "_view_name": "LayoutView",
7605 "align_content": null,
7606 "align_items": null,
7607 "align_self": null,
7608 "border": null,
7609 "bottom": null,
7610 "display": null,
7611 "flex": "2",
7612 "flex_flow": null,
7613 "grid_area": null,
7614 "grid_auto_columns": null,
7615 "grid_auto_flow": null,
7616 "grid_auto_rows": null,
7617 "grid_column": null,
7618 "grid_gap": null,
7619 "grid_row": null,
7620 "grid_template_areas": null,
7621 "grid_template_columns": null,
7622 "grid_template_rows": null,
7623 "height": null,
7624 "justify_content": null,
7625 "justify_items": null,
7626 "left": null,
7627 "margin": null,
7628 "max_height": null,
7629 "max_width": null,
7630 "min_height": null,
7631 "min_width": null,
7632 "object_fit": null,
7633 "object_position": null,
7634 "order": null,
7635 "overflow": null,
7636 "overflow_x": null,
7637 "overflow_y": null,
7638 "padding": null,
7639 "right": null,
7640 "top": null,
7641 "visibility": null,
7642 "width": null
7643 }
7644 },
7645 "5722085f090c4851a1cde4daf7db77df": {
7646 "model_module": "@jupyter-widgets/controls",
7647 "model_name": "ProgressStyleModel",
7648 "model_module_version": "1.5.0",
7649 "state": {
7650 "_model_module": "@jupyter-widgets/controls",
7651 "_model_module_version": "1.5.0",
7652 "_model_name": "ProgressStyleModel",
7653 "_view_count": null,
7654 "_view_module": "@jupyter-widgets/base",
7655 "_view_module_version": "1.2.0",
7656 "_view_name": "StyleView",
7657 "bar_color": null,
7658 "description_width": ""
7659 }
7660 },
7661 "7aed32af8b134b56a041ebb25c32640c": {
7662 "model_module": "@jupyter-widgets/base",
7663 "model_name": "LayoutModel",
7664 "model_module_version": "1.2.0",
7665 "state": {
7666 "_model_module": "@jupyter-widgets/base",
7667 "_model_module_version": "1.2.0",
7668 "_model_name": "LayoutModel",
7669 "_view_count": null,
7670 "_view_module": "@jupyter-widgets/base",
7671 "_view_module_version": "1.2.0",
7672 "_view_name": "LayoutView",
7673 "align_content": null,
7674 "align_items": null,
7675 "align_self": null,
7676 "border": null,
7677 "bottom": null,
7678 "display": null,
7679 "flex": null,
7680 "flex_flow": null,
7681 "grid_area": null,
7682 "grid_auto_columns": null,
7683 "grid_auto_flow": null,
7684 "grid_auto_rows": null,
7685 "grid_column": null,
7686 "grid_gap": null,
7687 "grid_row": null,
7688 "grid_template_areas": null,
7689 "grid_template_columns": null,
7690 "grid_template_rows": null,
7691 "height": null,
7692 "justify_content": null,
7693 "justify_items": null,
7694 "left": null,
7695 "margin": null,
7696 "max_height": null,
7697 "max_width": null,
7698 "min_height": null,
7699 "min_width": null,
7700 "object_fit": null,
7701 "object_position": null,
7702 "order": null,
7703 "overflow": null,
7704 "overflow_x": null,
7705 "overflow_y": null,
7706 "padding": null,
7707 "right": null,
7708 "top": null,
7709 "visibility": null,
7710 "width": null
7711 }
7712 },
7713 "a723ce7408e14b63b6d4311051dca322": {
7714 "model_module": "@jupyter-widgets/controls",
7715 "model_name": "DescriptionStyleModel",
7716 "model_module_version": "1.5.0",
7717 "state": {
7718 "_model_module": "@jupyter-widgets/controls",
7719 "_model_module_version": "1.5.0",
7720 "_model_name": "DescriptionStyleModel",
7721 "_view_count": null,
7722 "_view_module": "@jupyter-widgets/base",
7723 "_view_module_version": "1.2.0",
7724 "_view_name": "StyleView",
7725 "description_width": ""
7726 }
7727 },
7728 "3a9c42437ab34710a3fd3a75cf9cfac4": {
7729 "model_module": "@jupyter-widgets/controls",
7730 "model_name": "HBoxModel",
7731 "model_module_version": "1.5.0",
7732 "state": {
7733 "_dom_classes": [],
7734 "_model_module": "@jupyter-widgets/controls",
7735 "_model_module_version": "1.5.0",
7736 "_model_name": "HBoxModel",
7737 "_view_count": null,
7738 "_view_module": "@jupyter-widgets/controls",
7739 "_view_module_version": "1.5.0",
7740 "_view_name": "HBoxView",
7741 "box_style": "",
7742 "children": [
7743 "IPY_MODEL_80a0d8b6e16b4ceb98bb8911b0fa596c",
7744 "IPY_MODEL_9310b29cec49404b8dfc9feb8e5bac9f",
7745 "IPY_MODEL_44341f0cb29440a2bef7f711517a01ff"
7746 ],
7747 "layout": "IPY_MODEL_9739202e0849427d9fe61210e231837c"
7748 }
7749 },
7750 "80a0d8b6e16b4ceb98bb8911b0fa596c": {
7751 "model_module": "@jupyter-widgets/controls",
7752 "model_name": "HTMLModel",
7753 "model_module_version": "1.5.0",
7754 "state": {
7755 "_dom_classes": [],
7756 "_model_module": "@jupyter-widgets/controls",
7757 "_model_module_version": "1.5.0",
7758 "_model_name": "HTMLModel",
7759 "_view_count": null,
7760 "_view_module": "@jupyter-widgets/controls",
7761 "_view_module_version": "1.5.0",
7762 "_view_name": "HTMLView",
7763 "description": "",
7764 "description_tooltip": null,
7765 "layout": "IPY_MODEL_c43c9d3bbacf478b9fafc076ea58ad29",
7766 "placeholder": "​",
7767 "style": "IPY_MODEL_abfa8dc54e654a61b93ec9a15f5fe67e",
7768 "value": "Validation DataLoader 0: 100%"
7769 }
7770 },
7771 "9310b29cec49404b8dfc9feb8e5bac9f": {
7772 "model_module": "@jupyter-widgets/controls",
7773 "model_name": "FloatProgressModel",
7774 "model_module_version": "1.5.0",
7775 "state": {
7776 "_dom_classes": [],
7777 "_model_module": "@jupyter-widgets/controls",
7778 "_model_module_version": "1.5.0",
7779 "_model_name": "FloatProgressModel",
7780 "_view_count": null,
7781 "_view_module": "@jupyter-widgets/controls",
7782 "_view_module_version": "1.5.0",
7783 "_view_name": "ProgressView",
7784 "bar_style": "",
7785 "description": "",
7786 "description_tooltip": null,
7787 "layout": "IPY_MODEL_979514f924c6441098f7b7231ae15900",
7788 "max": 1,
7789 "min": 0,
7790 "orientation": "horizontal",
7791 "style": "IPY_MODEL_bbef9cf5cf2d42adb650caba73919e06",
7792 "value": 1
7793 }
7794 },
7795 "44341f0cb29440a2bef7f711517a01ff": {
7796 "model_module": "@jupyter-widgets/controls",
7797 "model_name": "HTMLModel",
7798 "model_module_version": "1.5.0",
7799 "state": {
7800 "_dom_classes": [],
7801 "_model_module": "@jupyter-widgets/controls",
7802 "_model_module_version": "1.5.0",
7803 "_model_name": "HTMLModel",
7804 "_view_count": null,
7805 "_view_module": "@jupyter-widgets/controls",
7806 "_view_module_version": "1.5.0",
7807 "_view_name": "HTMLView",
7808 "description": "",
7809 "description_tooltip": null,
7810 "layout": "IPY_MODEL_3b8da849443f401bb51a038f5bb82ad9",
7811 "placeholder": "​",
7812 "style": "IPY_MODEL_36f417b9e7e247b68e3bb18519af98b4",
7813 "value": " 1/1 [00:00&lt;00:00, 142.27it/s]"
7814 }
7815 },
7816 "9739202e0849427d9fe61210e231837c": {
7817 "model_module": "@jupyter-widgets/base",
7818 "model_name": "LayoutModel",
7819 "model_module_version": "1.2.0",
7820 "state": {
7821 "_model_module": "@jupyter-widgets/base",
7822 "_model_module_version": "1.2.0",
7823 "_model_name": "LayoutModel",
7824 "_view_count": null,
7825 "_view_module": "@jupyter-widgets/base",
7826 "_view_module_version": "1.2.0",
7827 "_view_name": "LayoutView",
7828 "align_content": null,
7829 "align_items": null,
7830 "align_self": null,
7831 "border": null,
7832 "bottom": null,
7833 "display": "inline-flex",
7834 "flex": null,
7835 "flex_flow": "row wrap",
7836 "grid_area": null,
7837 "grid_auto_columns": null,
7838 "grid_auto_flow": null,
7839 "grid_auto_rows": null,
7840 "grid_column": null,
7841 "grid_gap": null,
7842 "grid_row": null,
7843 "grid_template_areas": null,
7844 "grid_template_columns": null,
7845 "grid_template_rows": null,
7846 "height": null,
7847 "justify_content": null,
7848 "justify_items": null,
7849 "left": null,
7850 "margin": null,
7851 "max_height": null,
7852 "max_width": null,
7853 "min_height": null,
7854 "min_width": null,
7855 "object_fit": null,
7856 "object_position": null,
7857 "order": null,
7858 "overflow": null,
7859 "overflow_x": null,
7860 "overflow_y": null,
7861 "padding": null,
7862 "right": null,
7863 "top": null,
7864 "visibility": null,
7865 "width": "100%"
7866 }
7867 },
7868 "c43c9d3bbacf478b9fafc076ea58ad29": {
7869 "model_module": "@jupyter-widgets/base",
7870 "model_name": "LayoutModel",
7871 "model_module_version": "1.2.0",
7872 "state": {
7873 "_model_module": "@jupyter-widgets/base",
7874 "_model_module_version": "1.2.0",
7875 "_model_name": "LayoutModel",
7876 "_view_count": null,
7877 "_view_module": "@jupyter-widgets/base",
7878 "_view_module_version": "1.2.0",
7879 "_view_name": "LayoutView",
7880 "align_content": null,
7881 "align_items": null,
7882 "align_self": null,
7883 "border": null,
7884 "bottom": null,
7885 "display": null,
7886 "flex": null,
7887 "flex_flow": null,
7888 "grid_area": null,
7889 "grid_auto_columns": null,
7890 "grid_auto_flow": null,
7891 "grid_auto_rows": null,
7892 "grid_column": null,
7893 "grid_gap": null,
7894 "grid_row": null,
7895 "grid_template_areas": null,
7896 "grid_template_columns": null,
7897 "grid_template_rows": null,
7898 "height": null,
7899 "justify_content": null,
7900 "justify_items": null,
7901 "left": null,
7902 "margin": null,
7903 "max_height": null,
7904 "max_width": null,
7905 "min_height": null,
7906 "min_width": null,
7907 "object_fit": null,
7908 "object_position": null,
7909 "order": null,
7910 "overflow": null,
7911 "overflow_x": null,
7912 "overflow_y": null,
7913 "padding": null,
7914 "right": null,
7915 "top": null,
7916 "visibility": null,
7917 "width": null
7918 }
7919 },
7920 "abfa8dc54e654a61b93ec9a15f5fe67e": {
7921 "model_module": "@jupyter-widgets/controls",
7922 "model_name": "DescriptionStyleModel",
7923 "model_module_version": "1.5.0",
7924 "state": {
7925 "_model_module": "@jupyter-widgets/controls",
7926 "_model_module_version": "1.5.0",
7927 "_model_name": "DescriptionStyleModel",
7928 "_view_count": null,
7929 "_view_module": "@jupyter-widgets/base",
7930 "_view_module_version": "1.2.0",
7931 "_view_name": "StyleView",
7932 "description_width": ""
7933 }
7934 },
7935 "979514f924c6441098f7b7231ae15900": {
7936 "model_module": "@jupyter-widgets/base",
7937 "model_name": "LayoutModel",
7938 "model_module_version": "1.2.0",
7939 "state": {
7940 "_model_module": "@jupyter-widgets/base",
7941 "_model_module_version": "1.2.0",
7942 "_model_name": "LayoutModel",
7943 "_view_count": null,
7944 "_view_module": "@jupyter-widgets/base",
7945 "_view_module_version": "1.2.0",
7946 "_view_name": "LayoutView",
7947 "align_content": null,
7948 "align_items": null,
7949 "align_self": null,
7950 "border": null,
7951 "bottom": null,
7952 "display": null,
7953 "flex": "2",
7954 "flex_flow": null,
7955 "grid_area": null,
7956 "grid_auto_columns": null,
7957 "grid_auto_flow": null,
7958 "grid_auto_rows": null,
7959 "grid_column": null,
7960 "grid_gap": null,
7961 "grid_row": null,
7962 "grid_template_areas": null,
7963 "grid_template_columns": null,
7964 "grid_template_rows": null,
7965 "height": null,
7966 "justify_content": null,
7967 "justify_items": null,
7968 "left": null,
7969 "margin": null,
7970 "max_height": null,
7971 "max_width": null,
7972 "min_height": null,
7973 "min_width": null,
7974 "object_fit": null,
7975 "object_position": null,
7976 "order": null,
7977 "overflow": null,
7978 "overflow_x": null,
7979 "overflow_y": null,
7980 "padding": null,
7981 "right": null,
7982 "top": null,
7983 "visibility": null,
7984 "width": null
7985 }
7986 },
7987 "bbef9cf5cf2d42adb650caba73919e06": {
7988 "model_module": "@jupyter-widgets/controls",
7989 "model_name": "ProgressStyleModel",
7990 "model_module_version": "1.5.0",
7991 "state": {
7992 "_model_module": "@jupyter-widgets/controls",
7993 "_model_module_version": "1.5.0",
7994 "_model_name": "ProgressStyleModel",
7995 "_view_count": null,
7996 "_view_module": "@jupyter-widgets/base",
7997 "_view_module_version": "1.2.0",
7998 "_view_name": "StyleView",
7999 "bar_color": null,
8000 "description_width": ""
8001 }
8002 },
8003 "3b8da849443f401bb51a038f5bb82ad9": {
8004 "model_module": "@jupyter-widgets/base",
8005 "model_name": "LayoutModel",
8006 "model_module_version": "1.2.0",
8007 "state": {
8008 "_model_module": "@jupyter-widgets/base",
8009 "_model_module_version": "1.2.0",
8010 "_model_name": "LayoutModel",
8011 "_view_count": null,
8012 "_view_module": "@jupyter-widgets/base",
8013 "_view_module_version": "1.2.0",
8014 "_view_name": "LayoutView",
8015 "align_content": null,
8016 "align_items": null,
8017 "align_self": null,
8018 "border": null,
8019 "bottom": null,
8020 "display": null,
8021 "flex": null,
8022 "flex_flow": null,
8023 "grid_area": null,
8024 "grid_auto_columns": null,
8025 "grid_auto_flow": null,
8026 "grid_auto_rows": null,
8027 "grid_column": null,
8028 "grid_gap": null,
8029 "grid_row": null,
8030 "grid_template_areas": null,
8031 "grid_template_columns": null,
8032 "grid_template_rows": null,
8033 "height": null,
8034 "justify_content": null,
8035 "justify_items": null,
8036 "left": null,
8037 "margin": null,
8038 "max_height": null,
8039 "max_width": null,
8040 "min_height": null,
8041 "min_width": null,
8042 "object_fit": null,
8043 "object_position": null,
8044 "order": null,
8045 "overflow": null,
8046 "overflow_x": null,
8047 "overflow_y": null,
8048 "padding": null,
8049 "right": null,
8050 "top": null,
8051 "visibility": null,
8052 "width": null
8053 }
8054 },
8055 "36f417b9e7e247b68e3bb18519af98b4": {
8056 "model_module": "@jupyter-widgets/controls",
8057 "model_name": "DescriptionStyleModel",
8058 "model_module_version": "1.5.0",
8059 "state": {
8060 "_model_module": "@jupyter-widgets/controls",
8061 "_model_module_version": "1.5.0",
8062 "_model_name": "DescriptionStyleModel",
8063 "_view_count": null,
8064 "_view_module": "@jupyter-widgets/base",
8065 "_view_module_version": "1.2.0",
8066 "_view_name": "StyleView",
8067 "description_width": ""
8068 }
8069 },
8070 "71643356b8954af5ab6cdf03df2825e3": {
8071 "model_module": "@jupyter-widgets/controls",
8072 "model_name": "HBoxModel",
8073 "model_module_version": "1.5.0",
8074 "state": {
8075 "_dom_classes": [],
8076 "_model_module": "@jupyter-widgets/controls",
8077 "_model_module_version": "1.5.0",
8078 "_model_name": "HBoxModel",
8079 "_view_count": null,
8080 "_view_module": "@jupyter-widgets/controls",
8081 "_view_module_version": "1.5.0",
8082 "_view_name": "HBoxView",
8083 "box_style": "",
8084 "children": [
8085 "IPY_MODEL_8d50b1a8e0ce4d018fe4a51240ddb35d",
8086 "IPY_MODEL_654d72723ed8474ca360102e896331d5",
8087 "IPY_MODEL_049d95dcfbb34e84a0060919fdb8f454"
8088 ],
8089 "layout": "IPY_MODEL_54955fa5560041c09f847a3afb39eecd"
8090 }
8091 },
8092 "8d50b1a8e0ce4d018fe4a51240ddb35d": {
8093 "model_module": "@jupyter-widgets/controls",
8094 "model_name": "HTMLModel",
8095 "model_module_version": "1.5.0",
8096 "state": {
8097 "_dom_classes": [],
8098 "_model_module": "@jupyter-widgets/controls",
8099 "_model_module_version": "1.5.0",
8100 "_model_name": "HTMLModel",
8101 "_view_count": null,
8102 "_view_module": "@jupyter-widgets/controls",
8103 "_view_module_version": "1.5.0",
8104 "_view_name": "HTMLView",
8105 "description": "",
8106 "description_tooltip": null,
8107 "layout": "IPY_MODEL_34b2c78ef1254853a377efc6fead2e95",
8108 "placeholder": "​",
8109 "style": "IPY_MODEL_4eda8d394bff4fbf98bc086737c75219",
8110 "value": "Validation DataLoader 0: 100%"
8111 }
8112 },
8113 "654d72723ed8474ca360102e896331d5": {
8114 "model_module": "@jupyter-widgets/controls",
8115 "model_name": "FloatProgressModel",
8116 "model_module_version": "1.5.0",
8117 "state": {
8118 "_dom_classes": [],
8119 "_model_module": "@jupyter-widgets/controls",
8120 "_model_module_version": "1.5.0",
8121 "_model_name": "FloatProgressModel",
8122 "_view_count": null,
8123 "_view_module": "@jupyter-widgets/controls",
8124 "_view_module_version": "1.5.0",
8125 "_view_name": "ProgressView",
8126 "bar_style": "",
8127 "description": "",
8128 "description_tooltip": null,
8129 "layout": "IPY_MODEL_4ca134b9e1df4136bd0d2660a82960cf",
8130 "max": 1,
8131 "min": 0,
8132 "orientation": "horizontal",
8133 "style": "IPY_MODEL_87cf68c4e8a245c686fbbe439f176b87",
8134 "value": 1
8135 }
8136 },
8137 "049d95dcfbb34e84a0060919fdb8f454": {
8138 "model_module": "@jupyter-widgets/controls",
8139 "model_name": "HTMLModel",
8140 "model_module_version": "1.5.0",
8141 "state": {
8142 "_dom_classes": [],
8143 "_model_module": "@jupyter-widgets/controls",
8144 "_model_module_version": "1.5.0",
8145 "_model_name": "HTMLModel",
8146 "_view_count": null,
8147 "_view_module": "@jupyter-widgets/controls",
8148 "_view_module_version": "1.5.0",
8149 "_view_name": "HTMLView",
8150 "description": "",
8151 "description_tooltip": null,
8152 "layout": "IPY_MODEL_6009ded338de4e5b9a204e6f1243bf05",
8153 "placeholder": "​",
8154 "style": "IPY_MODEL_f01a1f50e0a74faaacc35695590cea30",
8155 "value": " 1/1 [00:00&lt;00:00, 275.09it/s]"
8156 }
8157 },
8158 "54955fa5560041c09f847a3afb39eecd": {
8159 "model_module": "@jupyter-widgets/base",
8160 "model_name": "LayoutModel",
8161 "model_module_version": "1.2.0",
8162 "state": {
8163 "_model_module": "@jupyter-widgets/base",
8164 "_model_module_version": "1.2.0",
8165 "_model_name": "LayoutModel",
8166 "_view_count": null,
8167 "_view_module": "@jupyter-widgets/base",
8168 "_view_module_version": "1.2.0",
8169 "_view_name": "LayoutView",
8170 "align_content": null,
8171 "align_items": null,
8172 "align_self": null,
8173 "border": null,
8174 "bottom": null,
8175 "display": "inline-flex",
8176 "flex": null,
8177 "flex_flow": "row wrap",
8178 "grid_area": null,
8179 "grid_auto_columns": null,
8180 "grid_auto_flow": null,
8181 "grid_auto_rows": null,
8182 "grid_column": null,
8183 "grid_gap": null,
8184 "grid_row": null,
8185 "grid_template_areas": null,
8186 "grid_template_columns": null,
8187 "grid_template_rows": null,
8188 "height": null,
8189 "justify_content": null,
8190 "justify_items": null,
8191 "left": null,
8192 "margin": null,
8193 "max_height": null,
8194 "max_width": null,
8195 "min_height": null,
8196 "min_width": null,
8197 "object_fit": null,
8198 "object_position": null,
8199 "order": null,
8200 "overflow": null,
8201 "overflow_x": null,
8202 "overflow_y": null,
8203 "padding": null,
8204 "right": null,
8205 "top": null,
8206 "visibility": null,
8207 "width": "100%"
8208 }
8209 },
8210 "34b2c78ef1254853a377efc6fead2e95": {
8211 "model_module": "@jupyter-widgets/base",
8212 "model_name": "LayoutModel",
8213 "model_module_version": "1.2.0",
8214 "state": {
8215 "_model_module": "@jupyter-widgets/base",
8216 "_model_module_version": "1.2.0",
8217 "_model_name": "LayoutModel",
8218 "_view_count": null,
8219 "_view_module": "@jupyter-widgets/base",
8220 "_view_module_version": "1.2.0",
8221 "_view_name": "LayoutView",
8222 "align_content": null,
8223 "align_items": null,
8224 "align_self": null,
8225 "border": null,
8226 "bottom": null,
8227 "display": null,
8228 "flex": null,
8229 "flex_flow": null,
8230 "grid_area": null,
8231 "grid_auto_columns": null,
8232 "grid_auto_flow": null,
8233 "grid_auto_rows": null,
8234 "grid_column": null,
8235 "grid_gap": null,
8236 "grid_row": null,
8237 "grid_template_areas": null,
8238 "grid_template_columns": null,
8239 "grid_template_rows": null,
8240 "height": null,
8241 "justify_content": null,
8242 "justify_items": null,
8243 "left": null,
8244 "margin": null,
8245 "max_height": null,
8246 "max_width": null,
8247 "min_height": null,
8248 "min_width": null,
8249 "object_fit": null,
8250 "object_position": null,
8251 "order": null,
8252 "overflow": null,
8253 "overflow_x": null,
8254 "overflow_y": null,
8255 "padding": null,
8256 "right": null,
8257 "top": null,
8258 "visibility": null,
8259 "width": null
8260 }
8261 },
8262 "4eda8d394bff4fbf98bc086737c75219": {
8263 "model_module": "@jupyter-widgets/controls",
8264 "model_name": "DescriptionStyleModel",
8265 "model_module_version": "1.5.0",
8266 "state": {
8267 "_model_module": "@jupyter-widgets/controls",
8268 "_model_module_version": "1.5.0",
8269 "_model_name": "DescriptionStyleModel",
8270 "_view_count": null,
8271 "_view_module": "@jupyter-widgets/base",
8272 "_view_module_version": "1.2.0",
8273 "_view_name": "StyleView",
8274 "description_width": ""
8275 }
8276 },
8277 "4ca134b9e1df4136bd0d2660a82960cf": {
8278 "model_module": "@jupyter-widgets/base",
8279 "model_name": "LayoutModel",
8280 "model_module_version": "1.2.0",
8281 "state": {
8282 "_model_module": "@jupyter-widgets/base",
8283 "_model_module_version": "1.2.0",
8284 "_model_name": "LayoutModel",
8285 "_view_count": null,
8286 "_view_module": "@jupyter-widgets/base",
8287 "_view_module_version": "1.2.0",
8288 "_view_name": "LayoutView",
8289 "align_content": null,
8290 "align_items": null,
8291 "align_self": null,
8292 "border": null,
8293 "bottom": null,
8294 "display": null,
8295 "flex": "2",
8296 "flex_flow": null,
8297 "grid_area": null,
8298 "grid_auto_columns": null,
8299 "grid_auto_flow": null,
8300 "grid_auto_rows": null,
8301 "grid_column": null,
8302 "grid_gap": null,
8303 "grid_row": null,
8304 "grid_template_areas": null,
8305 "grid_template_columns": null,
8306 "grid_template_rows": null,
8307 "height": null,
8308 "justify_content": null,
8309 "justify_items": null,
8310 "left": null,
8311 "margin": null,
8312 "max_height": null,
8313 "max_width": null,
8314 "min_height": null,
8315 "min_width": null,
8316 "object_fit": null,
8317 "object_position": null,
8318 "order": null,
8319 "overflow": null,
8320 "overflow_x": null,
8321 "overflow_y": null,
8322 "padding": null,
8323 "right": null,
8324 "top": null,
8325 "visibility": null,
8326 "width": null
8327 }
8328 },
8329 "87cf68c4e8a245c686fbbe439f176b87": {
8330 "model_module": "@jupyter-widgets/controls",
8331 "model_name": "ProgressStyleModel",
8332 "model_module_version": "1.5.0",
8333 "state": {
8334 "_model_module": "@jupyter-widgets/controls",
8335 "_model_module_version": "1.5.0",
8336 "_model_name": "ProgressStyleModel",
8337 "_view_count": null,
8338 "_view_module": "@jupyter-widgets/base",
8339 "_view_module_version": "1.2.0",
8340 "_view_name": "StyleView",
8341 "bar_color": null,
8342 "description_width": ""
8343 }
8344 },
8345 "6009ded338de4e5b9a204e6f1243bf05": {
8346 "model_module": "@jupyter-widgets/base",
8347 "model_name": "LayoutModel",
8348 "model_module_version": "1.2.0",
8349 "state": {
8350 "_model_module": "@jupyter-widgets/base",
8351 "_model_module_version": "1.2.0",
8352 "_model_name": "LayoutModel",
8353 "_view_count": null,
8354 "_view_module": "@jupyter-widgets/base",
8355 "_view_module_version": "1.2.0",
8356 "_view_name": "LayoutView",
8357 "align_content": null,
8358 "align_items": null,
8359 "align_self": null,
8360 "border": null,
8361 "bottom": null,
8362 "display": null,
8363 "flex": null,
8364 "flex_flow": null,
8365 "grid_area": null,
8366 "grid_auto_columns": null,
8367 "grid_auto_flow": null,
8368 "grid_auto_rows": null,
8369 "grid_column": null,
8370 "grid_gap": null,
8371 "grid_row": null,
8372 "grid_template_areas": null,
8373 "grid_template_columns": null,
8374 "grid_template_rows": null,
8375 "height": null,
8376 "justify_content": null,
8377 "justify_items": null,
8378 "left": null,
8379 "margin": null,
8380 "max_height": null,
8381 "max_width": null,
8382 "min_height": null,
8383 "min_width": null,
8384 "object_fit": null,
8385 "object_position": null,
8386 "order": null,
8387 "overflow": null,
8388 "overflow_x": null,
8389 "overflow_y": null,
8390 "padding": null,
8391 "right": null,
8392 "top": null,
8393 "visibility": null,
8394 "width": null
8395 }
8396 },
8397 "f01a1f50e0a74faaacc35695590cea30": {
8398 "model_module": "@jupyter-widgets/controls",
8399 "model_name": "DescriptionStyleModel",
8400 "model_module_version": "1.5.0",
8401 "state": {
8402 "_model_module": "@jupyter-widgets/controls",
8403 "_model_module_version": "1.5.0",
8404 "_model_name": "DescriptionStyleModel",
8405 "_view_count": null,
8406 "_view_module": "@jupyter-widgets/base",
8407 "_view_module_version": "1.2.0",
8408 "_view_name": "StyleView",
8409 "description_width": ""
8410 }
8411 },
8412 "a76a4846aa11422785c1d0218c94b827": {
8413 "model_module": "@jupyter-widgets/controls",
8414 "model_name": "HBoxModel",
8415 "model_module_version": "1.5.0",
8416 "state": {
8417 "_dom_classes": [],
8418 "_model_module": "@jupyter-widgets/controls",
8419 "_model_module_version": "1.5.0",
8420 "_model_name": "HBoxModel",
8421 "_view_count": null,
8422 "_view_module": "@jupyter-widgets/controls",
8423 "_view_module_version": "1.5.0",
8424 "_view_name": "HBoxView",
8425 "box_style": "",
8426 "children": [
8427 "IPY_MODEL_373e3dd821954f33becb388c82ffebc2",
8428 "IPY_MODEL_9f532b8a64b3410f9a2e2a99755dac55",
8429 "IPY_MODEL_b457e104ad194032ba15070b89d42e6e"
8430 ],
8431 "layout": "IPY_MODEL_81fc3a7b94554a1980724ac6092fc88a"
8432 }
8433 },
8434 "373e3dd821954f33becb388c82ffebc2": {
8435 "model_module": "@jupyter-widgets/controls",
8436 "model_name": "HTMLModel",
8437 "model_module_version": "1.5.0",
8438 "state": {
8439 "_dom_classes": [],
8440 "_model_module": "@jupyter-widgets/controls",
8441 "_model_module_version": "1.5.0",
8442 "_model_name": "HTMLModel",
8443 "_view_count": null,
8444 "_view_module": "@jupyter-widgets/controls",
8445 "_view_module_version": "1.5.0",
8446 "_view_name": "HTMLView",
8447 "description": "",
8448 "description_tooltip": null,
8449 "layout": "IPY_MODEL_68908006e8eb4b31a55d1c0be51453bd",
8450 "placeholder": "​",
8451 "style": "IPY_MODEL_8f5c49525abe4d7a9ea746db18135f26",
8452 "value": "Validation DataLoader 0: 100%"
8453 }
8454 },
8455 "9f532b8a64b3410f9a2e2a99755dac55": {
8456 "model_module": "@jupyter-widgets/controls",
8457 "model_name": "FloatProgressModel",
8458 "model_module_version": "1.5.0",
8459 "state": {
8460 "_dom_classes": [],
8461 "_model_module": "@jupyter-widgets/controls",
8462 "_model_module_version": "1.5.0",
8463 "_model_name": "FloatProgressModel",
8464 "_view_count": null,
8465 "_view_module": "@jupyter-widgets/controls",
8466 "_view_module_version": "1.5.0",
8467 "_view_name": "ProgressView",
8468 "bar_style": "",
8469 "description": "",
8470 "description_tooltip": null,
8471 "layout": "IPY_MODEL_70eb5ab30ffb4b5bbe58832c6386a536",
8472 "max": 1,
8473 "min": 0,
8474 "orientation": "horizontal",
8475 "style": "IPY_MODEL_970d8a7e2b5c47a5bff8a036cadc9b84",
8476 "value": 1
8477 }
8478 },
8479 "b457e104ad194032ba15070b89d42e6e": {
8480 "model_module": "@jupyter-widgets/controls",
8481 "model_name": "HTMLModel",
8482 "model_module_version": "1.5.0",
8483 "state": {
8484 "_dom_classes": [],
8485 "_model_module": "@jupyter-widgets/controls",
8486 "_model_module_version": "1.5.0",
8487 "_model_name": "HTMLModel",
8488 "_view_count": null,
8489 "_view_module": "@jupyter-widgets/controls",
8490 "_view_module_version": "1.5.0",
8491 "_view_name": "HTMLView",
8492 "description": "",
8493 "description_tooltip": null,
8494 "layout": "IPY_MODEL_3ad7904ba48048bfa4b7a866cf4aa4a6",
8495 "placeholder": "​",
8496 "style": "IPY_MODEL_a20c551e949842f881c6def753eb81ed",
8497 "value": " 1/1 [00:00&lt;00:00, 159.05it/s]"
8498 }
8499 },
8500 "81fc3a7b94554a1980724ac6092fc88a": {
8501 "model_module": "@jupyter-widgets/base",
8502 "model_name": "LayoutModel",
8503 "model_module_version": "1.2.0",
8504 "state": {
8505 "_model_module": "@jupyter-widgets/base",
8506 "_model_module_version": "1.2.0",
8507 "_model_name": "LayoutModel",
8508 "_view_count": null,
8509 "_view_module": "@jupyter-widgets/base",
8510 "_view_module_version": "1.2.0",
8511 "_view_name": "LayoutView",
8512 "align_content": null,
8513 "align_items": null,
8514 "align_self": null,
8515 "border": null,
8516 "bottom": null,
8517 "display": "inline-flex",
8518 "flex": null,
8519 "flex_flow": "row wrap",
8520 "grid_area": null,
8521 "grid_auto_columns": null,
8522 "grid_auto_flow": null,
8523 "grid_auto_rows": null,
8524 "grid_column": null,
8525 "grid_gap": null,
8526 "grid_row": null,
8527 "grid_template_areas": null,
8528 "grid_template_columns": null,
8529 "grid_template_rows": null,
8530 "height": null,
8531 "justify_content": null,
8532 "justify_items": null,
8533 "left": null,
8534 "margin": null,
8535 "max_height": null,
8536 "max_width": null,
8537 "min_height": null,
8538 "min_width": null,
8539 "object_fit": null,
8540 "object_position": null,
8541 "order": null,
8542 "overflow": null,
8543 "overflow_x": null,
8544 "overflow_y": null,
8545 "padding": null,
8546 "right": null,
8547 "top": null,
8548 "visibility": null,
8549 "width": "100%"
8550 }
8551 },
8552 "68908006e8eb4b31a55d1c0be51453bd": {
8553 "model_module": "@jupyter-widgets/base",
8554 "model_name": "LayoutModel",
8555 "model_module_version": "1.2.0",
8556 "state": {
8557 "_model_module": "@jupyter-widgets/base",
8558 "_model_module_version": "1.2.0",
8559 "_model_name": "LayoutModel",
8560 "_view_count": null,
8561 "_view_module": "@jupyter-widgets/base",
8562 "_view_module_version": "1.2.0",
8563 "_view_name": "LayoutView",
8564 "align_content": null,
8565 "align_items": null,
8566 "align_self": null,
8567 "border": null,
8568 "bottom": null,
8569 "display": null,
8570 "flex": null,
8571 "flex_flow": null,
8572 "grid_area": null,
8573 "grid_auto_columns": null,
8574 "grid_auto_flow": null,
8575 "grid_auto_rows": null,
8576 "grid_column": null,
8577 "grid_gap": null,
8578 "grid_row": null,
8579 "grid_template_areas": null,
8580 "grid_template_columns": null,
8581 "grid_template_rows": null,
8582 "height": null,
8583 "justify_content": null,
8584 "justify_items": null,
8585 "left": null,
8586 "margin": null,
8587 "max_height": null,
8588 "max_width": null,
8589 "min_height": null,
8590 "min_width": null,
8591 "object_fit": null,
8592 "object_position": null,
8593 "order": null,
8594 "overflow": null,
8595 "overflow_x": null,
8596 "overflow_y": null,
8597 "padding": null,
8598 "right": null,
8599 "top": null,
8600 "visibility": null,
8601 "width": null
8602 }
8603 },
8604 "8f5c49525abe4d7a9ea746db18135f26": {
8605 "model_module": "@jupyter-widgets/controls",
8606 "model_name": "DescriptionStyleModel",
8607 "model_module_version": "1.5.0",
8608 "state": {
8609 "_model_module": "@jupyter-widgets/controls",
8610 "_model_module_version": "1.5.0",
8611 "_model_name": "DescriptionStyleModel",
8612 "_view_count": null,
8613 "_view_module": "@jupyter-widgets/base",
8614 "_view_module_version": "1.2.0",
8615 "_view_name": "StyleView",
8616 "description_width": ""
8617 }
8618 },
8619 "70eb5ab30ffb4b5bbe58832c6386a536": {
8620 "model_module": "@jupyter-widgets/base",
8621 "model_name": "LayoutModel",
8622 "model_module_version": "1.2.0",
8623 "state": {
8624 "_model_module": "@jupyter-widgets/base",
8625 "_model_module_version": "1.2.0",
8626 "_model_name": "LayoutModel",
8627 "_view_count": null,
8628 "_view_module": "@jupyter-widgets/base",
8629 "_view_module_version": "1.2.0",
8630 "_view_name": "LayoutView",
8631 "align_content": null,
8632 "align_items": null,
8633 "align_self": null,
8634 "border": null,
8635 "bottom": null,
8636 "display": null,
8637 "flex": "2",
8638 "flex_flow": null,
8639 "grid_area": null,
8640 "grid_auto_columns": null,
8641 "grid_auto_flow": null,
8642 "grid_auto_rows": null,
8643 "grid_column": null,
8644 "grid_gap": null,
8645 "grid_row": null,
8646 "grid_template_areas": null,
8647 "grid_template_columns": null,
8648 "grid_template_rows": null,
8649 "height": null,
8650 "justify_content": null,
8651 "justify_items": null,
8652 "left": null,
8653 "margin": null,
8654 "max_height": null,
8655 "max_width": null,
8656 "min_height": null,
8657 "min_width": null,
8658 "object_fit": null,
8659 "object_position": null,
8660 "order": null,
8661 "overflow": null,
8662 "overflow_x": null,
8663 "overflow_y": null,
8664 "padding": null,
8665 "right": null,
8666 "top": null,
8667 "visibility": null,
8668 "width": null
8669 }
8670 },
8671 "970d8a7e2b5c47a5bff8a036cadc9b84": {
8672 "model_module": "@jupyter-widgets/controls",
8673 "model_name": "ProgressStyleModel",
8674 "model_module_version": "1.5.0",
8675 "state": {
8676 "_model_module": "@jupyter-widgets/controls",
8677 "_model_module_version": "1.5.0",
8678 "_model_name": "ProgressStyleModel",
8679 "_view_count": null,
8680 "_view_module": "@jupyter-widgets/base",
8681 "_view_module_version": "1.2.0",
8682 "_view_name": "StyleView",
8683 "bar_color": null,
8684 "description_width": ""
8685 }
8686 },
8687 "3ad7904ba48048bfa4b7a866cf4aa4a6": {
8688 "model_module": "@jupyter-widgets/base",
8689 "model_name": "LayoutModel",
8690 "model_module_version": "1.2.0",
8691 "state": {
8692 "_model_module": "@jupyter-widgets/base",
8693 "_model_module_version": "1.2.0",
8694 "_model_name": "LayoutModel",
8695 "_view_count": null,
8696 "_view_module": "@jupyter-widgets/base",
8697 "_view_module_version": "1.2.0",
8698 "_view_name": "LayoutView",
8699 "align_content": null,
8700 "align_items": null,
8701 "align_self": null,
8702 "border": null,
8703 "bottom": null,
8704 "display": null,
8705 "flex": null,
8706 "flex_flow": null,
8707 "grid_area": null,
8708 "grid_auto_columns": null,
8709 "grid_auto_flow": null,
8710 "grid_auto_rows": null,
8711 "grid_column": null,
8712 "grid_gap": null,
8713 "grid_row": null,
8714 "grid_template_areas": null,
8715 "grid_template_columns": null,
8716 "grid_template_rows": null,
8717 "height": null,
8718 "justify_content": null,
8719 "justify_items": null,
8720 "left": null,
8721 "margin": null,
8722 "max_height": null,
8723 "max_width": null,
8724 "min_height": null,
8725 "min_width": null,
8726 "object_fit": null,
8727 "object_position": null,
8728 "order": null,
8729 "overflow": null,
8730 "overflow_x": null,
8731 "overflow_y": null,
8732 "padding": null,
8733 "right": null,
8734 "top": null,
8735 "visibility": null,
8736 "width": null
8737 }
8738 },
8739 "a20c551e949842f881c6def753eb81ed": {
8740 "model_module": "@jupyter-widgets/controls",
8741 "model_name": "DescriptionStyleModel",
8742 "model_module_version": "1.5.0",
8743 "state": {
8744 "_model_module": "@jupyter-widgets/controls",
8745 "_model_module_version": "1.5.0",
8746 "_model_name": "DescriptionStyleModel",
8747 "_view_count": null,
8748 "_view_module": "@jupyter-widgets/base",
8749 "_view_module_version": "1.2.0",
8750 "_view_name": "StyleView",
8751 "description_width": ""
8752 }
8753 },
8754 "67e1192ed6774aa9bb17f1d5a27695f9": {
8755 "model_module": "@jupyter-widgets/controls",
8756 "model_name": "HBoxModel",
8757 "model_module_version": "1.5.0",
8758 "state": {
8759 "_dom_classes": [],
8760 "_model_module": "@jupyter-widgets/controls",
8761 "_model_module_version": "1.5.0",
8762 "_model_name": "HBoxModel",
8763 "_view_count": null,
8764 "_view_module": "@jupyter-widgets/controls",
8765 "_view_module_version": "1.5.0",
8766 "_view_name": "HBoxView",
8767 "box_style": "",
8768 "children": [
8769 "IPY_MODEL_5aea05cbd78843bcb2a9d3df9e3abefd",
8770 "IPY_MODEL_4693d306ecaf44f2b6b505ca072e22bb",
8771 "IPY_MODEL_2e46fda9b283487ba4f118bad5a880c6"
8772 ],
8773 "layout": "IPY_MODEL_55a8b90a0a6c44eda0bedd43fda69c41"
8774 }
8775 },
8776 "5aea05cbd78843bcb2a9d3df9e3abefd": {
8777 "model_module": "@jupyter-widgets/controls",
8778 "model_name": "HTMLModel",
8779 "model_module_version": "1.5.0",
8780 "state": {
8781 "_dom_classes": [],
8782 "_model_module": "@jupyter-widgets/controls",
8783 "_model_module_version": "1.5.0",
8784 "_model_name": "HTMLModel",
8785 "_view_count": null,
8786 "_view_module": "@jupyter-widgets/controls",
8787 "_view_module_version": "1.5.0",
8788 "_view_name": "HTMLView",
8789 "description": "",
8790 "description_tooltip": null,
8791 "layout": "IPY_MODEL_a7e64bcbd09644a198b9f1c7d8a8d1c6",
8792 "placeholder": "​",
8793 "style": "IPY_MODEL_87a7b1169e1f404d81fddc56c0ba2145",
8794 "value": "Validation DataLoader 0: 100%"
8795 }
8796 },
8797 "4693d306ecaf44f2b6b505ca072e22bb": {
8798 "model_module": "@jupyter-widgets/controls",
8799 "model_name": "FloatProgressModel",
8800 "model_module_version": "1.5.0",
8801 "state": {
8802 "_dom_classes": [],
8803 "_model_module": "@jupyter-widgets/controls",
8804 "_model_module_version": "1.5.0",
8805 "_model_name": "FloatProgressModel",
8806 "_view_count": null,
8807 "_view_module": "@jupyter-widgets/controls",
8808 "_view_module_version": "1.5.0",
8809 "_view_name": "ProgressView",
8810 "bar_style": "",
8811 "description": "",
8812 "description_tooltip": null,
8813 "layout": "IPY_MODEL_921d621e89a64e1aab62397758e26592",
8814 "max": 1,
8815 "min": 0,
8816 "orientation": "horizontal",
8817 "style": "IPY_MODEL_da9024d63c56460b9ca061d5cd1bb985",
8818 "value": 1
8819 }
8820 },
8821 "2e46fda9b283487ba4f118bad5a880c6": {
8822 "model_module": "@jupyter-widgets/controls",
8823 "model_name": "HTMLModel",
8824 "model_module_version": "1.5.0",
8825 "state": {
8826 "_dom_classes": [],
8827 "_model_module": "@jupyter-widgets/controls",
8828 "_model_module_version": "1.5.0",
8829 "_model_name": "HTMLModel",
8830 "_view_count": null,
8831 "_view_module": "@jupyter-widgets/controls",
8832 "_view_module_version": "1.5.0",
8833 "_view_name": "HTMLView",
8834 "description": "",
8835 "description_tooltip": null,
8836 "layout": "IPY_MODEL_503e7b032b3d44d49e15587060b25e56",
8837 "placeholder": "​",
8838 "style": "IPY_MODEL_1361830025974670a174df70957feabc",
8839 "value": " 1/1 [00:00&lt;00:00, 109.92it/s]"
8840 }
8841 },
8842 "55a8b90a0a6c44eda0bedd43fda69c41": {
8843 "model_module": "@jupyter-widgets/base",
8844 "model_name": "LayoutModel",
8845 "model_module_version": "1.2.0",
8846 "state": {
8847 "_model_module": "@jupyter-widgets/base",
8848 "_model_module_version": "1.2.0",
8849 "_model_name": "LayoutModel",
8850 "_view_count": null,
8851 "_view_module": "@jupyter-widgets/base",
8852 "_view_module_version": "1.2.0",
8853 "_view_name": "LayoutView",
8854 "align_content": null,
8855 "align_items": null,
8856 "align_self": null,
8857 "border": null,
8858 "bottom": null,
8859 "display": "inline-flex",
8860 "flex": null,
8861 "flex_flow": "row wrap",
8862 "grid_area": null,
8863 "grid_auto_columns": null,
8864 "grid_auto_flow": null,
8865 "grid_auto_rows": null,
8866 "grid_column": null,
8867 "grid_gap": null,
8868 "grid_row": null,
8869 "grid_template_areas": null,
8870 "grid_template_columns": null,
8871 "grid_template_rows": null,
8872 "height": null,
8873 "justify_content": null,
8874 "justify_items": null,
8875 "left": null,
8876 "margin": null,
8877 "max_height": null,
8878 "max_width": null,
8879 "min_height": null,
8880 "min_width": null,
8881 "object_fit": null,
8882 "object_position": null,
8883 "order": null,
8884 "overflow": null,
8885 "overflow_x": null,
8886 "overflow_y": null,
8887 "padding": null,
8888 "right": null,
8889 "top": null,
8890 "visibility": null,
8891 "width": "100%"
8892 }
8893 },
8894 "a7e64bcbd09644a198b9f1c7d8a8d1c6": {
8895 "model_module": "@jupyter-widgets/base",
8896 "model_name": "LayoutModel",
8897 "model_module_version": "1.2.0",
8898 "state": {
8899 "_model_module": "@jupyter-widgets/base",
8900 "_model_module_version": "1.2.0",
8901 "_model_name": "LayoutModel",
8902 "_view_count": null,
8903 "_view_module": "@jupyter-widgets/base",
8904 "_view_module_version": "1.2.0",
8905 "_view_name": "LayoutView",
8906 "align_content": null,
8907 "align_items": null,
8908 "align_self": null,
8909 "border": null,
8910 "bottom": null,
8911 "display": null,
8912 "flex": null,
8913 "flex_flow": null,
8914 "grid_area": null,
8915 "grid_auto_columns": null,
8916 "grid_auto_flow": null,
8917 "grid_auto_rows": null,
8918 "grid_column": null,
8919 "grid_gap": null,
8920 "grid_row": null,
8921 "grid_template_areas": null,
8922 "grid_template_columns": null,
8923 "grid_template_rows": null,
8924 "height": null,
8925 "justify_content": null,
8926 "justify_items": null,
8927 "left": null,
8928 "margin": null,
8929 "max_height": null,
8930 "max_width": null,
8931 "min_height": null,
8932 "min_width": null,
8933 "object_fit": null,
8934 "object_position": null,
8935 "order": null,
8936 "overflow": null,
8937 "overflow_x": null,
8938 "overflow_y": null,
8939 "padding": null,
8940 "right": null,
8941 "top": null,
8942 "visibility": null,
8943 "width": null
8944 }
8945 },
8946 "87a7b1169e1f404d81fddc56c0ba2145": {
8947 "model_module": "@jupyter-widgets/controls",
8948 "model_name": "DescriptionStyleModel",
8949 "model_module_version": "1.5.0",
8950 "state": {
8951 "_model_module": "@jupyter-widgets/controls",
8952 "_model_module_version": "1.5.0",
8953 "_model_name": "DescriptionStyleModel",
8954 "_view_count": null,
8955 "_view_module": "@jupyter-widgets/base",
8956 "_view_module_version": "1.2.0",
8957 "_view_name": "StyleView",
8958 "description_width": ""
8959 }
8960 },
8961 "921d621e89a64e1aab62397758e26592": {
8962 "model_module": "@jupyter-widgets/base",
8963 "model_name": "LayoutModel",
8964 "model_module_version": "1.2.0",
8965 "state": {
8966 "_model_module": "@jupyter-widgets/base",
8967 "_model_module_version": "1.2.0",
8968 "_model_name": "LayoutModel",
8969 "_view_count": null,
8970 "_view_module": "@jupyter-widgets/base",
8971 "_view_module_version": "1.2.0",
8972 "_view_name": "LayoutView",
8973 "align_content": null,
8974 "align_items": null,
8975 "align_self": null,
8976 "border": null,
8977 "bottom": null,
8978 "display": null,
8979 "flex": "2",
8980 "flex_flow": null,
8981 "grid_area": null,
8982 "grid_auto_columns": null,
8983 "grid_auto_flow": null,
8984 "grid_auto_rows": null,
8985 "grid_column": null,
8986 "grid_gap": null,
8987 "grid_row": null,
8988 "grid_template_areas": null,
8989 "grid_template_columns": null,
8990 "grid_template_rows": null,
8991 "height": null,
8992 "justify_content": null,
8993 "justify_items": null,
8994 "left": null,
8995 "margin": null,
8996 "max_height": null,
8997 "max_width": null,
8998 "min_height": null,
8999 "min_width": null,
9000 "object_fit": null,
9001 "object_position": null,
9002 "order": null,
9003 "overflow": null,
9004 "overflow_x": null,
9005 "overflow_y": null,
9006 "padding": null,
9007 "right": null,
9008 "top": null,
9009 "visibility": null,
9010 "width": null
9011 }
9012 },
9013 "da9024d63c56460b9ca061d5cd1bb985": {
9014 "model_module": "@jupyter-widgets/controls",
9015 "model_name": "ProgressStyleModel",
9016 "model_module_version": "1.5.0",
9017 "state": {
9018 "_model_module": "@jupyter-widgets/controls",
9019 "_model_module_version": "1.5.0",
9020 "_model_name": "ProgressStyleModel",
9021 "_view_count": null,
9022 "_view_module": "@jupyter-widgets/base",
9023 "_view_module_version": "1.2.0",
9024 "_view_name": "StyleView",
9025 "bar_color": null,
9026 "description_width": ""
9027 }
9028 },
9029 "503e7b032b3d44d49e15587060b25e56": {
9030 "model_module": "@jupyter-widgets/base",
9031 "model_name": "LayoutModel",
9032 "model_module_version": "1.2.0",
9033 "state": {
9034 "_model_module": "@jupyter-widgets/base",
9035 "_model_module_version": "1.2.0",
9036 "_model_name": "LayoutModel",
9037 "_view_count": null,
9038 "_view_module": "@jupyter-widgets/base",
9039 "_view_module_version": "1.2.0",
9040 "_view_name": "LayoutView",
9041 "align_content": null,
9042 "align_items": null,
9043 "align_self": null,
9044 "border": null,
9045 "bottom": null,
9046 "display": null,
9047 "flex": null,
9048 "flex_flow": null,
9049 "grid_area": null,
9050 "grid_auto_columns": null,
9051 "grid_auto_flow": null,
9052 "grid_auto_rows": null,
9053 "grid_column": null,
9054 "grid_gap": null,
9055 "grid_row": null,
9056 "grid_template_areas": null,
9057 "grid_template_columns": null,
9058 "grid_template_rows": null,
9059 "height": null,
9060 "justify_content": null,
9061 "justify_items": null,
9062 "left": null,
9063 "margin": null,
9064 "max_height": null,
9065 "max_width": null,
9066 "min_height": null,
9067 "min_width": null,
9068 "object_fit": null,
9069 "object_position": null,
9070 "order": null,
9071 "overflow": null,
9072 "overflow_x": null,
9073 "overflow_y": null,
9074 "padding": null,
9075 "right": null,
9076 "top": null,
9077 "visibility": null,
9078 "width": null
9079 }
9080 },
9081 "1361830025974670a174df70957feabc": {
9082 "model_module": "@jupyter-widgets/controls",
9083 "model_name": "DescriptionStyleModel",
9084 "model_module_version": "1.5.0",
9085 "state": {
9086 "_model_module": "@jupyter-widgets/controls",
9087 "_model_module_version": "1.5.0",
9088 "_model_name": "DescriptionStyleModel",
9089 "_view_count": null,
9090 "_view_module": "@jupyter-widgets/base",
9091 "_view_module_version": "1.2.0",
9092 "_view_name": "StyleView",
9093 "description_width": ""
9094 }
9095 },
9096 "6adb0fc2977b41e7bce4e81909c6c931": {
9097 "model_module": "@jupyter-widgets/controls",
9098 "model_name": "HBoxModel",
9099 "model_module_version": "1.5.0",
9100 "state": {
9101 "_dom_classes": [],
9102 "_model_module": "@jupyter-widgets/controls",
9103 "_model_module_version": "1.5.0",
9104 "_model_name": "HBoxModel",
9105 "_view_count": null,
9106 "_view_module": "@jupyter-widgets/controls",
9107 "_view_module_version": "1.5.0",
9108 "_view_name": "HBoxView",
9109 "box_style": "",
9110 "children": [
9111 "IPY_MODEL_ab9b58483e0145aab2f22a8bbf0422cf",
9112 "IPY_MODEL_6725fd421a9344feb552ee1a1ce84dda",
9113 "IPY_MODEL_0d712617055b45a3b6f5783dfe6a5842"
9114 ],
9115 "layout": "IPY_MODEL_1c5fdfd620eb47c28dcb91ff04ea6155"
9116 }
9117 },
9118 "ab9b58483e0145aab2f22a8bbf0422cf": {
9119 "model_module": "@jupyter-widgets/controls",
9120 "model_name": "HTMLModel",
9121 "model_module_version": "1.5.0",
9122 "state": {
9123 "_dom_classes": [],
9124 "_model_module": "@jupyter-widgets/controls",
9125 "_model_module_version": "1.5.0",
9126 "_model_name": "HTMLModel",
9127 "_view_count": null,
9128 "_view_module": "@jupyter-widgets/controls",
9129 "_view_module_version": "1.5.0",
9130 "_view_name": "HTMLView",
9131 "description": "",
9132 "description_tooltip": null,
9133 "layout": "IPY_MODEL_db2185de343a4f76a2b2ecfad4e658ad",
9134 "placeholder": "​",
9135 "style": "IPY_MODEL_bb1efececaef471c90c3bc9cc2fb5ac7",
9136 "value": "Validation DataLoader 0: 100%"
9137 }
9138 },
9139 "6725fd421a9344feb552ee1a1ce84dda": {
9140 "model_module": "@jupyter-widgets/controls",
9141 "model_name": "FloatProgressModel",
9142 "model_module_version": "1.5.0",
9143 "state": {
9144 "_dom_classes": [],
9145 "_model_module": "@jupyter-widgets/controls",
9146 "_model_module_version": "1.5.0",
9147 "_model_name": "FloatProgressModel",
9148 "_view_count": null,
9149 "_view_module": "@jupyter-widgets/controls",
9150 "_view_module_version": "1.5.0",
9151 "_view_name": "ProgressView",
9152 "bar_style": "",
9153 "description": "",
9154 "description_tooltip": null,
9155 "layout": "IPY_MODEL_7a49920285474268b1cb3f57e73a450e",
9156 "max": 1,
9157 "min": 0,
9158 "orientation": "horizontal",
9159 "style": "IPY_MODEL_b0e5dea19289434ebe98002e3cfe6086",
9160 "value": 1
9161 }
9162 },
9163 "0d712617055b45a3b6f5783dfe6a5842": {
9164 "model_module": "@jupyter-widgets/controls",
9165 "model_name": "HTMLModel",
9166 "model_module_version": "1.5.0",
9167 "state": {
9168 "_dom_classes": [],
9169 "_model_module": "@jupyter-widgets/controls",
9170 "_model_module_version": "1.5.0",
9171 "_model_name": "HTMLModel",
9172 "_view_count": null,
9173 "_view_module": "@jupyter-widgets/controls",
9174 "_view_module_version": "1.5.0",
9175 "_view_name": "HTMLView",
9176 "description": "",
9177 "description_tooltip": null,
9178 "layout": "IPY_MODEL_92a8cbc6f6344e49a455c9e3df2c552f",
9179 "placeholder": "​",
9180 "style": "IPY_MODEL_b41986dd9910458e95ddfff0b1a508d1",
9181 "value": " 1/1 [00:00&lt;00:00, 197.98it/s]"
9182 }
9183 },
9184 "1c5fdfd620eb47c28dcb91ff04ea6155": {
9185 "model_module": "@jupyter-widgets/base",
9186 "model_name": "LayoutModel",
9187 "model_module_version": "1.2.0",
9188 "state": {
9189 "_model_module": "@jupyter-widgets/base",
9190 "_model_module_version": "1.2.0",
9191 "_model_name": "LayoutModel",
9192 "_view_count": null,
9193 "_view_module": "@jupyter-widgets/base",
9194 "_view_module_version": "1.2.0",
9195 "_view_name": "LayoutView",
9196 "align_content": null,
9197 "align_items": null,
9198 "align_self": null,
9199 "border": null,
9200 "bottom": null,
9201 "display": "inline-flex",
9202 "flex": null,
9203 "flex_flow": "row wrap",
9204 "grid_area": null,
9205 "grid_auto_columns": null,
9206 "grid_auto_flow": null,
9207 "grid_auto_rows": null,
9208 "grid_column": null,
9209 "grid_gap": null,
9210 "grid_row": null,
9211 "grid_template_areas": null,
9212 "grid_template_columns": null,
9213 "grid_template_rows": null,
9214 "height": null,
9215 "justify_content": null,
9216 "justify_items": null,
9217 "left": null,
9218 "margin": null,
9219 "max_height": null,
9220 "max_width": null,
9221 "min_height": null,
9222 "min_width": null,
9223 "object_fit": null,
9224 "object_position": null,
9225 "order": null,
9226 "overflow": null,
9227 "overflow_x": null,
9228 "overflow_y": null,
9229 "padding": null,
9230 "right": null,
9231 "top": null,
9232 "visibility": null,
9233 "width": "100%"
9234 }
9235 },
9236 "db2185de343a4f76a2b2ecfad4e658ad": {
9237 "model_module": "@jupyter-widgets/base",
9238 "model_name": "LayoutModel",
9239 "model_module_version": "1.2.0",
9240 "state": {
9241 "_model_module": "@jupyter-widgets/base",
9242 "_model_module_version": "1.2.0",
9243 "_model_name": "LayoutModel",
9244 "_view_count": null,
9245 "_view_module": "@jupyter-widgets/base",
9246 "_view_module_version": "1.2.0",
9247 "_view_name": "LayoutView",
9248 "align_content": null,
9249 "align_items": null,
9250 "align_self": null,
9251 "border": null,
9252 "bottom": null,
9253 "display": null,
9254 "flex": null,
9255 "flex_flow": null,
9256 "grid_area": null,
9257 "grid_auto_columns": null,
9258 "grid_auto_flow": null,
9259 "grid_auto_rows": null,
9260 "grid_column": null,
9261 "grid_gap": null,
9262 "grid_row": null,
9263 "grid_template_areas": null,
9264 "grid_template_columns": null,
9265 "grid_template_rows": null,
9266 "height": null,
9267 "justify_content": null,
9268 "justify_items": null,
9269 "left": null,
9270 "margin": null,
9271 "max_height": null,
9272 "max_width": null,
9273 "min_height": null,
9274 "min_width": null,
9275 "object_fit": null,
9276 "object_position": null,
9277 "order": null,
9278 "overflow": null,
9279 "overflow_x": null,
9280 "overflow_y": null,
9281 "padding": null,
9282 "right": null,
9283 "top": null,
9284 "visibility": null,
9285 "width": null
9286 }
9287 },
9288 "bb1efececaef471c90c3bc9cc2fb5ac7": {
9289 "model_module": "@jupyter-widgets/controls",
9290 "model_name": "DescriptionStyleModel",
9291 "model_module_version": "1.5.0",
9292 "state": {
9293 "_model_module": "@jupyter-widgets/controls",
9294 "_model_module_version": "1.5.0",
9295 "_model_name": "DescriptionStyleModel",
9296 "_view_count": null,
9297 "_view_module": "@jupyter-widgets/base",
9298 "_view_module_version": "1.2.0",
9299 "_view_name": "StyleView",
9300 "description_width": ""
9301 }
9302 },
9303 "7a49920285474268b1cb3f57e73a450e": {
9304 "model_module": "@jupyter-widgets/base",
9305 "model_name": "LayoutModel",
9306 "model_module_version": "1.2.0",
9307 "state": {
9308 "_model_module": "@jupyter-widgets/base",
9309 "_model_module_version": "1.2.0",
9310 "_model_name": "LayoutModel",
9311 "_view_count": null,
9312 "_view_module": "@jupyter-widgets/base",
9313 "_view_module_version": "1.2.0",
9314 "_view_name": "LayoutView",
9315 "align_content": null,
9316 "align_items": null,
9317 "align_self": null,
9318 "border": null,
9319 "bottom": null,
9320 "display": null,
9321 "flex": "2",
9322 "flex_flow": null,
9323 "grid_area": null,
9324 "grid_auto_columns": null,
9325 "grid_auto_flow": null,
9326 "grid_auto_rows": null,
9327 "grid_column": null,
9328 "grid_gap": null,
9329 "grid_row": null,
9330 "grid_template_areas": null,
9331 "grid_template_columns": null,
9332 "grid_template_rows": null,
9333 "height": null,
9334 "justify_content": null,
9335 "justify_items": null,
9336 "left": null,
9337 "margin": null,
9338 "max_height": null,
9339 "max_width": null,
9340 "min_height": null,
9341 "min_width": null,
9342 "object_fit": null,
9343 "object_position": null,
9344 "order": null,
9345 "overflow": null,
9346 "overflow_x": null,
9347 "overflow_y": null,
9348 "padding": null,
9349 "right": null,
9350 "top": null,
9351 "visibility": null,
9352 "width": null
9353 }
9354 },
9355 "b0e5dea19289434ebe98002e3cfe6086": {
9356 "model_module": "@jupyter-widgets/controls",
9357 "model_name": "ProgressStyleModel",
9358 "model_module_version": "1.5.0",
9359 "state": {
9360 "_model_module": "@jupyter-widgets/controls",
9361 "_model_module_version": "1.5.0",
9362 "_model_name": "ProgressStyleModel",
9363 "_view_count": null,
9364 "_view_module": "@jupyter-widgets/base",
9365 "_view_module_version": "1.2.0",
9366 "_view_name": "StyleView",
9367 "bar_color": null,
9368 "description_width": ""
9369 }
9370 },
9371 "92a8cbc6f6344e49a455c9e3df2c552f": {
9372 "model_module": "@jupyter-widgets/base",
9373 "model_name": "LayoutModel",
9374 "model_module_version": "1.2.0",
9375 "state": {
9376 "_model_module": "@jupyter-widgets/base",
9377 "_model_module_version": "1.2.0",
9378 "_model_name": "LayoutModel",
9379 "_view_count": null,
9380 "_view_module": "@jupyter-widgets/base",
9381 "_view_module_version": "1.2.0",
9382 "_view_name": "LayoutView",
9383 "align_content": null,
9384 "align_items": null,
9385 "align_self": null,
9386 "border": null,
9387 "bottom": null,
9388 "display": null,
9389 "flex": null,
9390 "flex_flow": null,
9391 "grid_area": null,
9392 "grid_auto_columns": null,
9393 "grid_auto_flow": null,
9394 "grid_auto_rows": null,
9395 "grid_column": null,
9396 "grid_gap": null,
9397 "grid_row": null,
9398 "grid_template_areas": null,
9399 "grid_template_columns": null,
9400 "grid_template_rows": null,
9401 "height": null,
9402 "justify_content": null,
9403 "justify_items": null,
9404 "left": null,
9405 "margin": null,
9406 "max_height": null,
9407 "max_width": null,
9408 "min_height": null,
9409 "min_width": null,
9410 "object_fit": null,
9411 "object_position": null,
9412 "order": null,
9413 "overflow": null,
9414 "overflow_x": null,
9415 "overflow_y": null,
9416 "padding": null,
9417 "right": null,
9418 "top": null,
9419 "visibility": null,
9420 "width": null
9421 }
9422 },
9423 "b41986dd9910458e95ddfff0b1a508d1": {
9424 "model_module": "@jupyter-widgets/controls",
9425 "model_name": "DescriptionStyleModel",
9426 "model_module_version": "1.5.0",
9427 "state": {
9428 "_model_module": "@jupyter-widgets/controls",
9429 "_model_module_version": "1.5.0",
9430 "_model_name": "DescriptionStyleModel",
9431 "_view_count": null,
9432 "_view_module": "@jupyter-widgets/base",
9433 "_view_module_version": "1.2.0",
9434 "_view_name": "StyleView",
9435 "description_width": ""
9436 }
9437 },
9438 "f2fb2d0dfed54272abbc0560a467c97e": {
9439 "model_module": "@jupyter-widgets/controls",
9440 "model_name": "HBoxModel",
9441 "model_module_version": "1.5.0",
9442 "state": {
9443 "_dom_classes": [],
9444 "_model_module": "@jupyter-widgets/controls",
9445 "_model_module_version": "1.5.0",
9446 "_model_name": "HBoxModel",
9447 "_view_count": null,
9448 "_view_module": "@jupyter-widgets/controls",
9449 "_view_module_version": "1.5.0",
9450 "_view_name": "HBoxView",
9451 "box_style": "",
9452 "children": [
9453 "IPY_MODEL_08c1e9701d0b4f2e8b34027af81ab586",
9454 "IPY_MODEL_1ea2399f27404d5cbfffd68efbd472fc",
9455 "IPY_MODEL_affc022e069a41af877cf9fbe3889012"
9456 ],
9457 "layout": "IPY_MODEL_65490339b12e47d6b35cbf4a16d1bfeb"
9458 }
9459 },
9460 "08c1e9701d0b4f2e8b34027af81ab586": {
9461 "model_module": "@jupyter-widgets/controls",
9462 "model_name": "HTMLModel",
9463 "model_module_version": "1.5.0",
9464 "state": {
9465 "_dom_classes": [],
9466 "_model_module": "@jupyter-widgets/controls",
9467 "_model_module_version": "1.5.0",
9468 "_model_name": "HTMLModel",
9469 "_view_count": null,
9470 "_view_module": "@jupyter-widgets/controls",
9471 "_view_module_version": "1.5.0",
9472 "_view_name": "HTMLView",
9473 "description": "",
9474 "description_tooltip": null,
9475 "layout": "IPY_MODEL_10247683189c43b6abf3df0b7818bcd9",
9476 "placeholder": "​",
9477 "style": "IPY_MODEL_10b0f64c86714778919d55c643550ff5",
9478 "value": "Validation DataLoader 0: 100%"
9479 }
9480 },
9481 "1ea2399f27404d5cbfffd68efbd472fc": {
9482 "model_module": "@jupyter-widgets/controls",
9483 "model_name": "FloatProgressModel",
9484 "model_module_version": "1.5.0",
9485 "state": {
9486 "_dom_classes": [],
9487 "_model_module": "@jupyter-widgets/controls",
9488 "_model_module_version": "1.5.0",
9489 "_model_name": "FloatProgressModel",
9490 "_view_count": null,
9491 "_view_module": "@jupyter-widgets/controls",
9492 "_view_module_version": "1.5.0",
9493 "_view_name": "ProgressView",
9494 "bar_style": "",
9495 "description": "",
9496 "description_tooltip": null,
9497 "layout": "IPY_MODEL_a702202230484af5b32a4653f0eac288",
9498 "max": 1,
9499 "min": 0,
9500 "orientation": "horizontal",
9501 "style": "IPY_MODEL_5e38b9f21ce04bcc820f711c9c47678d",
9502 "value": 1
9503 }
9504 },
9505 "affc022e069a41af877cf9fbe3889012": {
9506 "model_module": "@jupyter-widgets/controls",
9507 "model_name": "HTMLModel",
9508 "model_module_version": "1.5.0",
9509 "state": {
9510 "_dom_classes": [],
9511 "_model_module": "@jupyter-widgets/controls",
9512 "_model_module_version": "1.5.0",
9513 "_model_name": "HTMLModel",
9514 "_view_count": null,
9515 "_view_module": "@jupyter-widgets/controls",
9516 "_view_module_version": "1.5.0",
9517 "_view_name": "HTMLView",
9518 "description": "",
9519 "description_tooltip": null,
9520 "layout": "IPY_MODEL_2771553d801f4961ad94344e2d5caacd",
9521 "placeholder": "​",
9522 "style": "IPY_MODEL_134808b58f1f42b09c4b2353a94bbb0e",
9523 "value": " 1/1 [00:00&lt;00:00, 87.08it/s]"
9524 }
9525 },
9526 "65490339b12e47d6b35cbf4a16d1bfeb": {
9527 "model_module": "@jupyter-widgets/base",
9528 "model_name": "LayoutModel",
9529 "model_module_version": "1.2.0",
9530 "state": {
9531 "_model_module": "@jupyter-widgets/base",
9532 "_model_module_version": "1.2.0",
9533 "_model_name": "LayoutModel",
9534 "_view_count": null,
9535 "_view_module": "@jupyter-widgets/base",
9536 "_view_module_version": "1.2.0",
9537 "_view_name": "LayoutView",
9538 "align_content": null,
9539 "align_items": null,
9540 "align_self": null,
9541 "border": null,
9542 "bottom": null,
9543 "display": "inline-flex",
9544 "flex": null,
9545 "flex_flow": "row wrap",
9546 "grid_area": null,
9547 "grid_auto_columns": null,
9548 "grid_auto_flow": null,
9549 "grid_auto_rows": null,
9550 "grid_column": null,
9551 "grid_gap": null,
9552 "grid_row": null,
9553 "grid_template_areas": null,
9554 "grid_template_columns": null,
9555 "grid_template_rows": null,
9556 "height": null,
9557 "justify_content": null,
9558 "justify_items": null,
9559 "left": null,
9560 "margin": null,
9561 "max_height": null,
9562 "max_width": null,
9563 "min_height": null,
9564 "min_width": null,
9565 "object_fit": null,
9566 "object_position": null,
9567 "order": null,
9568 "overflow": null,
9569 "overflow_x": null,
9570 "overflow_y": null,
9571 "padding": null,
9572 "right": null,
9573 "top": null,
9574 "visibility": null,
9575 "width": "100%"
9576 }
9577 },
9578 "10247683189c43b6abf3df0b7818bcd9": {
9579 "model_module": "@jupyter-widgets/base",
9580 "model_name": "LayoutModel",
9581 "model_module_version": "1.2.0",
9582 "state": {
9583 "_model_module": "@jupyter-widgets/base",
9584 "_model_module_version": "1.2.0",
9585 "_model_name": "LayoutModel",
9586 "_view_count": null,
9587 "_view_module": "@jupyter-widgets/base",
9588 "_view_module_version": "1.2.0",
9589 "_view_name": "LayoutView",
9590 "align_content": null,
9591 "align_items": null,
9592 "align_self": null,
9593 "border": null,
9594 "bottom": null,
9595 "display": null,
9596 "flex": null,
9597 "flex_flow": null,
9598 "grid_area": null,
9599 "grid_auto_columns": null,
9600 "grid_auto_flow": null,
9601 "grid_auto_rows": null,
9602 "grid_column": null,
9603 "grid_gap": null,
9604 "grid_row": null,
9605 "grid_template_areas": null,
9606 "grid_template_columns": null,
9607 "grid_template_rows": null,
9608 "height": null,
9609 "justify_content": null,
9610 "justify_items": null,
9611 "left": null,
9612 "margin": null,
9613 "max_height": null,
9614 "max_width": null,
9615 "min_height": null,
9616 "min_width": null,
9617 "object_fit": null,
9618 "object_position": null,
9619 "order": null,
9620 "overflow": null,
9621 "overflow_x": null,
9622 "overflow_y": null,
9623 "padding": null,
9624 "right": null,
9625 "top": null,
9626 "visibility": null,
9627 "width": null
9628 }
9629 },
9630 "10b0f64c86714778919d55c643550ff5": {
9631 "model_module": "@jupyter-widgets/controls",
9632 "model_name": "DescriptionStyleModel",
9633 "model_module_version": "1.5.0",
9634 "state": {
9635 "_model_module": "@jupyter-widgets/controls",
9636 "_model_module_version": "1.5.0",
9637 "_model_name": "DescriptionStyleModel",
9638 "_view_count": null,
9639 "_view_module": "@jupyter-widgets/base",
9640 "_view_module_version": "1.2.0",
9641 "_view_name": "StyleView",
9642 "description_width": ""
9643 }
9644 },
9645 "a702202230484af5b32a4653f0eac288": {
9646 "model_module": "@jupyter-widgets/base",
9647 "model_name": "LayoutModel",
9648 "model_module_version": "1.2.0",
9649 "state": {
9650 "_model_module": "@jupyter-widgets/base",
9651 "_model_module_version": "1.2.0",
9652 "_model_name": "LayoutModel",
9653 "_view_count": null,
9654 "_view_module": "@jupyter-widgets/base",
9655 "_view_module_version": "1.2.0",
9656 "_view_name": "LayoutView",
9657 "align_content": null,
9658 "align_items": null,
9659 "align_self": null,
9660 "border": null,
9661 "bottom": null,
9662 "display": null,
9663 "flex": "2",
9664 "flex_flow": null,
9665 "grid_area": null,
9666 "grid_auto_columns": null,
9667 "grid_auto_flow": null,
9668 "grid_auto_rows": null,
9669 "grid_column": null,
9670 "grid_gap": null,
9671 "grid_row": null,
9672 "grid_template_areas": null,
9673 "grid_template_columns": null,
9674 "grid_template_rows": null,
9675 "height": null,
9676 "justify_content": null,
9677 "justify_items": null,
9678 "left": null,
9679 "margin": null,
9680 "max_height": null,
9681 "max_width": null,
9682 "min_height": null,
9683 "min_width": null,
9684 "object_fit": null,
9685 "object_position": null,
9686 "order": null,
9687 "overflow": null,
9688 "overflow_x": null,
9689 "overflow_y": null,
9690 "padding": null,
9691 "right": null,
9692 "top": null,
9693 "visibility": null,
9694 "width": null
9695 }
9696 },
9697 "5e38b9f21ce04bcc820f711c9c47678d": {
9698 "model_module": "@jupyter-widgets/controls",
9699 "model_name": "ProgressStyleModel",
9700 "model_module_version": "1.5.0",
9701 "state": {
9702 "_model_module": "@jupyter-widgets/controls",
9703 "_model_module_version": "1.5.0",
9704 "_model_name": "ProgressStyleModel",
9705 "_view_count": null,
9706 "_view_module": "@jupyter-widgets/base",
9707 "_view_module_version": "1.2.0",
9708 "_view_name": "StyleView",
9709 "bar_color": null,
9710 "description_width": ""
9711 }
9712 },
9713 "2771553d801f4961ad94344e2d5caacd": {
9714 "model_module": "@jupyter-widgets/base",
9715 "model_name": "LayoutModel",
9716 "model_module_version": "1.2.0",
9717 "state": {
9718 "_model_module": "@jupyter-widgets/base",
9719 "_model_module_version": "1.2.0",
9720 "_model_name": "LayoutModel",
9721 "_view_count": null,
9722 "_view_module": "@jupyter-widgets/base",
9723 "_view_module_version": "1.2.0",
9724 "_view_name": "LayoutView",
9725 "align_content": null,
9726 "align_items": null,
9727 "align_self": null,
9728 "border": null,
9729 "bottom": null,
9730 "display": null,
9731 "flex": null,
9732 "flex_flow": null,
9733 "grid_area": null,
9734 "grid_auto_columns": null,
9735 "grid_auto_flow": null,
9736 "grid_auto_rows": null,
9737 "grid_column": null,
9738 "grid_gap": null,
9739 "grid_row": null,
9740 "grid_template_areas": null,
9741 "grid_template_columns": null,
9742 "grid_template_rows": null,
9743 "height": null,
9744 "justify_content": null,
9745 "justify_items": null,
9746 "left": null,
9747 "margin": null,
9748 "max_height": null,
9749 "max_width": null,
9750 "min_height": null,
9751 "min_width": null,
9752 "object_fit": null,
9753 "object_position": null,
9754 "order": null,
9755 "overflow": null,
9756 "overflow_x": null,
9757 "overflow_y": null,
9758 "padding": null,
9759 "right": null,
9760 "top": null,
9761 "visibility": null,
9762 "width": null
9763 }
9764 },
9765 "134808b58f1f42b09c4b2353a94bbb0e": {
9766 "model_module": "@jupyter-widgets/controls",
9767 "model_name": "DescriptionStyleModel",
9768 "model_module_version": "1.5.0",
9769 "state": {
9770 "_model_module": "@jupyter-widgets/controls",
9771 "_model_module_version": "1.5.0",
9772 "_model_name": "DescriptionStyleModel",
9773 "_view_count": null,
9774 "_view_module": "@jupyter-widgets/base",
9775 "_view_module_version": "1.2.0",
9776 "_view_name": "StyleView",
9777 "description_width": ""
9778 }
9779 },
9780 "02bda666a850468086acea36156397c7": {
9781 "model_module": "@jupyter-widgets/controls",
9782 "model_name": "HBoxModel",
9783 "model_module_version": "1.5.0",
9784 "state": {
9785 "_dom_classes": [],
9786 "_model_module": "@jupyter-widgets/controls",
9787 "_model_module_version": "1.5.0",
9788 "_model_name": "HBoxModel",
9789 "_view_count": null,
9790 "_view_module": "@jupyter-widgets/controls",
9791 "_view_module_version": "1.5.0",
9792 "_view_name": "HBoxView",
9793 "box_style": "",
9794 "children": [
9795 "IPY_MODEL_9abed88d016f4822bf19e71dcf997571",
9796 "IPY_MODEL_6ea72db4ae8b45ec96508a51c21b6974",
9797 "IPY_MODEL_7baafb061feb455e9b37622dc9a4c724"
9798 ],
9799 "layout": "IPY_MODEL_ba06f72e44694ecd9fa51e984b4dc8bf"
9800 }
9801 },
9802 "9abed88d016f4822bf19e71dcf997571": {
9803 "model_module": "@jupyter-widgets/controls",
9804 "model_name": "HTMLModel",
9805 "model_module_version": "1.5.0",
9806 "state": {
9807 "_dom_classes": [],
9808 "_model_module": "@jupyter-widgets/controls",
9809 "_model_module_version": "1.5.0",
9810 "_model_name": "HTMLModel",
9811 "_view_count": null,
9812 "_view_module": "@jupyter-widgets/controls",
9813 "_view_module_version": "1.5.0",
9814 "_view_name": "HTMLView",
9815 "description": "",
9816 "description_tooltip": null,
9817 "layout": "IPY_MODEL_136c4f60a8734c578129fd843ee7ab5f",
9818 "placeholder": "​",
9819 "style": "IPY_MODEL_28f475b19b08458c81ee0cfb11c9d9c3",
9820 "value": "Validation DataLoader 0: 100%"
9821 }
9822 },
9823 "6ea72db4ae8b45ec96508a51c21b6974": {
9824 "model_module": "@jupyter-widgets/controls",
9825 "model_name": "FloatProgressModel",
9826 "model_module_version": "1.5.0",
9827 "state": {
9828 "_dom_classes": [],
9829 "_model_module": "@jupyter-widgets/controls",
9830 "_model_module_version": "1.5.0",
9831 "_model_name": "FloatProgressModel",
9832 "_view_count": null,
9833 "_view_module": "@jupyter-widgets/controls",
9834 "_view_module_version": "1.5.0",
9835 "_view_name": "ProgressView",
9836 "bar_style": "",
9837 "description": "",
9838 "description_tooltip": null,
9839 "layout": "IPY_MODEL_604fd938ec7d41f285e1f1b9cb9c6eac",
9840 "max": 1,
9841 "min": 0,
9842 "orientation": "horizontal",
9843 "style": "IPY_MODEL_07bb79027e20401e84d02a33a628b397",
9844 "value": 1
9845 }
9846 },
9847 "7baafb061feb455e9b37622dc9a4c724": {
9848 "model_module": "@jupyter-widgets/controls",
9849 "model_name": "HTMLModel",
9850 "model_module_version": "1.5.0",
9851 "state": {
9852 "_dom_classes": [],
9853 "_model_module": "@jupyter-widgets/controls",
9854 "_model_module_version": "1.5.0",
9855 "_model_name": "HTMLModel",
9856 "_view_count": null,
9857 "_view_module": "@jupyter-widgets/controls",
9858 "_view_module_version": "1.5.0",
9859 "_view_name": "HTMLView",
9860 "description": "",
9861 "description_tooltip": null,
9862 "layout": "IPY_MODEL_288ab1d98c7a4e21af429773a9fe3534",
9863 "placeholder": "​",
9864 "style": "IPY_MODEL_19a6a91b0d4e46d9be72aee530a974ce",
9865 "value": " 1/1 [00:00&lt;00:00, 94.33it/s]"
9866 }
9867 },
9868 "ba06f72e44694ecd9fa51e984b4dc8bf": {
9869 "model_module": "@jupyter-widgets/base",
9870 "model_name": "LayoutModel",
9871 "model_module_version": "1.2.0",
9872 "state": {
9873 "_model_module": "@jupyter-widgets/base",
9874 "_model_module_version": "1.2.0",
9875 "_model_name": "LayoutModel",
9876 "_view_count": null,
9877 "_view_module": "@jupyter-widgets/base",
9878 "_view_module_version": "1.2.0",
9879 "_view_name": "LayoutView",
9880 "align_content": null,
9881 "align_items": null,
9882 "align_self": null,
9883 "border": null,
9884 "bottom": null,
9885 "display": "inline-flex",
9886 "flex": null,
9887 "flex_flow": "row wrap",
9888 "grid_area": null,
9889 "grid_auto_columns": null,
9890 "grid_auto_flow": null,
9891 "grid_auto_rows": null,
9892 "grid_column": null,
9893 "grid_gap": null,
9894 "grid_row": null,
9895 "grid_template_areas": null,
9896 "grid_template_columns": null,
9897 "grid_template_rows": null,
9898 "height": null,
9899 "justify_content": null,
9900 "justify_items": null,
9901 "left": null,
9902 "margin": null,
9903 "max_height": null,
9904 "max_width": null,
9905 "min_height": null,
9906 "min_width": null,
9907 "object_fit": null,
9908 "object_position": null,
9909 "order": null,
9910 "overflow": null,
9911 "overflow_x": null,
9912 "overflow_y": null,
9913 "padding": null,
9914 "right": null,
9915 "top": null,
9916 "visibility": null,
9917 "width": "100%"
9918 }
9919 },
9920 "136c4f60a8734c578129fd843ee7ab5f": {
9921 "model_module": "@jupyter-widgets/base",
9922 "model_name": "LayoutModel",
9923 "model_module_version": "1.2.0",
9924 "state": {
9925 "_model_module": "@jupyter-widgets/base",
9926 "_model_module_version": "1.2.0",
9927 "_model_name": "LayoutModel",
9928 "_view_count": null,
9929 "_view_module": "@jupyter-widgets/base",
9930 "_view_module_version": "1.2.0",
9931 "_view_name": "LayoutView",
9932 "align_content": null,
9933 "align_items": null,
9934 "align_self": null,
9935 "border": null,
9936 "bottom": null,
9937 "display": null,
9938 "flex": null,
9939 "flex_flow": null,
9940 "grid_area": null,
9941 "grid_auto_columns": null,
9942 "grid_auto_flow": null,
9943 "grid_auto_rows": null,
9944 "grid_column": null,
9945 "grid_gap": null,
9946 "grid_row": null,
9947 "grid_template_areas": null,
9948 "grid_template_columns": null,
9949 "grid_template_rows": null,
9950 "height": null,
9951 "justify_content": null,
9952 "justify_items": null,
9953 "left": null,
9954 "margin": null,
9955 "max_height": null,
9956 "max_width": null,
9957 "min_height": null,
9958 "min_width": null,
9959 "object_fit": null,
9960 "object_position": null,
9961 "order": null,
9962 "overflow": null,
9963 "overflow_x": null,
9964 "overflow_y": null,
9965 "padding": null,
9966 "right": null,
9967 "top": null,
9968 "visibility": null,
9969 "width": null
9970 }
9971 },
9972 "28f475b19b08458c81ee0cfb11c9d9c3": {
9973 "model_module": "@jupyter-widgets/controls",
9974 "model_name": "DescriptionStyleModel",
9975 "model_module_version": "1.5.0",
9976 "state": {
9977 "_model_module": "@jupyter-widgets/controls",
9978 "_model_module_version": "1.5.0",
9979 "_model_name": "DescriptionStyleModel",
9980 "_view_count": null,
9981 "_view_module": "@jupyter-widgets/base",
9982 "_view_module_version": "1.2.0",
9983 "_view_name": "StyleView",
9984 "description_width": ""
9985 }
9986 },
9987 "604fd938ec7d41f285e1f1b9cb9c6eac": {
9988 "model_module": "@jupyter-widgets/base",
9989 "model_name": "LayoutModel",
9990 "model_module_version": "1.2.0",
9991 "state": {
9992 "_model_module": "@jupyter-widgets/base",
9993 "_model_module_version": "1.2.0",
9994 "_model_name": "LayoutModel",
9995 "_view_count": null,
9996 "_view_module": "@jupyter-widgets/base",
9997 "_view_module_version": "1.2.0",
9998 "_view_name": "LayoutView",
9999 "align_content": null,
10000 "align_items": null,
10001 "align_self": null,
10002 "border": null,
10003 "bottom": null,
10004 "display": null,
10005 "flex": "2",
10006 "flex_flow": null,
10007 "grid_area": null,
10008 "grid_auto_columns": null,
10009 "grid_auto_flow": null,
10010 "grid_auto_rows": null,
10011 "grid_column": null,
10012 "grid_gap": null,
10013 "grid_row": null,
10014 "grid_template_areas": null,
10015 "grid_template_columns": null,
10016 "grid_template_rows": null,
10017 "height": null,
10018 "justify_content": null,
10019 "justify_items": null,
10020 "left": null,
10021 "margin": null,
10022 "max_height": null,
10023 "max_width": null,
10024 "min_height": null,
10025 "min_width": null,
10026 "object_fit": null,
10027 "object_position": null,
10028 "order": null,
10029 "overflow": null,
10030 "overflow_x": null,
10031 "overflow_y": null,
10032 "padding": null,
10033 "right": null,
10034 "top": null,
10035 "visibility": null,
10036 "width": null
10037 }
10038 },
10039 "07bb79027e20401e84d02a33a628b397": {
10040 "model_module": "@jupyter-widgets/controls",
10041 "model_name": "ProgressStyleModel",
10042 "model_module_version": "1.5.0",
10043 "state": {
10044 "_model_module": "@jupyter-widgets/controls",
10045 "_model_module_version": "1.5.0",
10046 "_model_name": "ProgressStyleModel",
10047 "_view_count": null,
10048 "_view_module": "@jupyter-widgets/base",
10049 "_view_module_version": "1.2.0",
10050 "_view_name": "StyleView",
10051 "bar_color": null,
10052 "description_width": ""
10053 }
10054 },
10055 "288ab1d98c7a4e21af429773a9fe3534": {
10056 "model_module": "@jupyter-widgets/base",
10057 "model_name": "LayoutModel",
10058 "model_module_version": "1.2.0",
10059 "state": {
10060 "_model_module": "@jupyter-widgets/base",
10061 "_model_module_version": "1.2.0",
10062 "_model_name": "LayoutModel",
10063 "_view_count": null,
10064 "_view_module": "@jupyter-widgets/base",
10065 "_view_module_version": "1.2.0",
10066 "_view_name": "LayoutView",
10067 "align_content": null,
10068 "align_items": null,
10069 "align_self": null,
10070 "border": null,
10071 "bottom": null,
10072 "display": null,
10073 "flex": null,
10074 "flex_flow": null,
10075 "grid_area": null,
10076 "grid_auto_columns": null,
10077 "grid_auto_flow": null,
10078 "grid_auto_rows": null,
10079 "grid_column": null,
10080 "grid_gap": null,
10081 "grid_row": null,
10082 "grid_template_areas": null,
10083 "grid_template_columns": null,
10084 "grid_template_rows": null,
10085 "height": null,
10086 "justify_content": null,
10087 "justify_items": null,
10088 "left": null,
10089 "margin": null,
10090 "max_height": null,
10091 "max_width": null,
10092 "min_height": null,
10093 "min_width": null,
10094 "object_fit": null,
10095 "object_position": null,
10096 "order": null,
10097 "overflow": null,
10098 "overflow_x": null,
10099 "overflow_y": null,
10100 "padding": null,
10101 "right": null,
10102 "top": null,
10103 "visibility": null,
10104 "width": null
10105 }
10106 },
10107 "19a6a91b0d4e46d9be72aee530a974ce": {
10108 "model_module": "@jupyter-widgets/controls",
10109 "model_name": "DescriptionStyleModel",
10110 "model_module_version": "1.5.0",
10111 "state": {
10112 "_model_module": "@jupyter-widgets/controls",
10113 "_model_module_version": "1.5.0",
10114 "_model_name": "DescriptionStyleModel",
10115 "_view_count": null,
10116 "_view_module": "@jupyter-widgets/base",
10117 "_view_module_version": "1.2.0",
10118 "_view_name": "StyleView",
10119 "description_width": ""
10120 }
10121 },
10122 "0de2ddf45f754c5991a62ae8e822c4b7": {
10123 "model_module": "@jupyter-widgets/controls",
10124 "model_name": "HBoxModel",
10125 "model_module_version": "1.5.0",
10126 "state": {
10127 "_dom_classes": [],
10128 "_model_module": "@jupyter-widgets/controls",
10129 "_model_module_version": "1.5.0",
10130 "_model_name": "HBoxModel",
10131 "_view_count": null,
10132 "_view_module": "@jupyter-widgets/controls",
10133 "_view_module_version": "1.5.0",
10134 "_view_name": "HBoxView",
10135 "box_style": "",
10136 "children": [
10137 "IPY_MODEL_a6fb10bec45f4f1a9243b466eb95c017",
10138 "IPY_MODEL_44ce5ef7a8af4fb291da012fa53e0c5a",
10139 "IPY_MODEL_9c40cc6348cb4bcfb59e0457399cd72b"
10140 ],
10141 "layout": "IPY_MODEL_3f9455a7a52947638545cff45b1e807d"
10142 }
10143 },
10144 "a6fb10bec45f4f1a9243b466eb95c017": {
10145 "model_module": "@jupyter-widgets/controls",
10146 "model_name": "HTMLModel",
10147 "model_module_version": "1.5.0",
10148 "state": {
10149 "_dom_classes": [],
10150 "_model_module": "@jupyter-widgets/controls",
10151 "_model_module_version": "1.5.0",
10152 "_model_name": "HTMLModel",
10153 "_view_count": null,
10154 "_view_module": "@jupyter-widgets/controls",
10155 "_view_module_version": "1.5.0",
10156 "_view_name": "HTMLView",
10157 "description": "",
10158 "description_tooltip": null,
10159 "layout": "IPY_MODEL_22550ebc70ef4671a65bb1a041c9def7",
10160 "placeholder": "​",
10161 "style": "IPY_MODEL_67f022dd80234c08849906615a1191dc",
10162 "value": "Validation DataLoader 0: 100%"
10163 }
10164 },
10165 "44ce5ef7a8af4fb291da012fa53e0c5a": {
10166 "model_module": "@jupyter-widgets/controls",
10167 "model_name": "FloatProgressModel",
10168 "model_module_version": "1.5.0",
10169 "state": {
10170 "_dom_classes": [],
10171 "_model_module": "@jupyter-widgets/controls",
10172 "_model_module_version": "1.5.0",
10173 "_model_name": "FloatProgressModel",
10174 "_view_count": null,
10175 "_view_module": "@jupyter-widgets/controls",
10176 "_view_module_version": "1.5.0",
10177 "_view_name": "ProgressView",
10178 "bar_style": "",
10179 "description": "",
10180 "description_tooltip": null,
10181 "layout": "IPY_MODEL_2e5e169b1ad64407ad8c3494a70b314f",
10182 "max": 1,
10183 "min": 0,
10184 "orientation": "horizontal",
10185 "style": "IPY_MODEL_277e7a95b41447b4a52824c212e6fa7c",
10186 "value": 1
10187 }
10188 },
10189 "9c40cc6348cb4bcfb59e0457399cd72b": {
10190 "model_module": "@jupyter-widgets/controls",
10191 "model_name": "HTMLModel",
10192 "model_module_version": "1.5.0",
10193 "state": {
10194 "_dom_classes": [],
10195 "_model_module": "@jupyter-widgets/controls",
10196 "_model_module_version": "1.5.0",
10197 "_model_name": "HTMLModel",
10198 "_view_count": null,
10199 "_view_module": "@jupyter-widgets/controls",
10200 "_view_module_version": "1.5.0",
10201 "_view_name": "HTMLView",
10202 "description": "",
10203 "description_tooltip": null,
10204 "layout": "IPY_MODEL_d07c7bcf6a934fae9e015be66a1f860d",
10205 "placeholder": "​",
10206 "style": "IPY_MODEL_c5e484430b0843689d7cfb434d0aa8da",
10207 "value": " 1/1 [00:00&lt;00:00, 102.23it/s]"
10208 }
10209 },
10210 "3f9455a7a52947638545cff45b1e807d": {
10211 "model_module": "@jupyter-widgets/base",
10212 "model_name": "LayoutModel",
10213 "model_module_version": "1.2.0",
10214 "state": {
10215 "_model_module": "@jupyter-widgets/base",
10216 "_model_module_version": "1.2.0",
10217 "_model_name": "LayoutModel",
10218 "_view_count": null,
10219 "_view_module": "@jupyter-widgets/base",
10220 "_view_module_version": "1.2.0",
10221 "_view_name": "LayoutView",
10222 "align_content": null,
10223 "align_items": null,
10224 "align_self": null,
10225 "border": null,
10226 "bottom": null,
10227 "display": "inline-flex",
10228 "flex": null,
10229 "flex_flow": "row wrap",
10230 "grid_area": null,
10231 "grid_auto_columns": null,
10232 "grid_auto_flow": null,
10233 "grid_auto_rows": null,
10234 "grid_column": null,
10235 "grid_gap": null,
10236 "grid_row": null,
10237 "grid_template_areas": null,
10238 "grid_template_columns": null,
10239 "grid_template_rows": null,
10240 "height": null,
10241 "justify_content": null,
10242 "justify_items": null,
10243 "left": null,
10244 "margin": null,
10245 "max_height": null,
10246 "max_width": null,
10247 "min_height": null,
10248 "min_width": null,
10249 "object_fit": null,
10250 "object_position": null,
10251 "order": null,
10252 "overflow": null,
10253 "overflow_x": null,
10254 "overflow_y": null,
10255 "padding": null,
10256 "right": null,
10257 "top": null,
10258 "visibility": null,
10259 "width": "100%"
10260 }
10261 },
10262 "22550ebc70ef4671a65bb1a041c9def7": {
10263 "model_module": "@jupyter-widgets/base",
10264 "model_name": "LayoutModel",
10265 "model_module_version": "1.2.0",
10266 "state": {
10267 "_model_module": "@jupyter-widgets/base",
10268 "_model_module_version": "1.2.0",
10269 "_model_name": "LayoutModel",
10270 "_view_count": null,
10271 "_view_module": "@jupyter-widgets/base",
10272 "_view_module_version": "1.2.0",
10273 "_view_name": "LayoutView",
10274 "align_content": null,
10275 "align_items": null,
10276 "align_self": null,
10277 "border": null,
10278 "bottom": null,
10279 "display": null,
10280 "flex": null,
10281 "flex_flow": null,
10282 "grid_area": null,
10283 "grid_auto_columns": null,
10284 "grid_auto_flow": null,
10285 "grid_auto_rows": null,
10286 "grid_column": null,
10287 "grid_gap": null,
10288 "grid_row": null,
10289 "grid_template_areas": null,
10290 "grid_template_columns": null,
10291 "grid_template_rows": null,
10292 "height": null,
10293 "justify_content": null,
10294 "justify_items": null,
10295 "left": null,
10296 "margin": null,
10297 "max_height": null,
10298 "max_width": null,
10299 "min_height": null,
10300 "min_width": null,
10301 "object_fit": null,
10302 "object_position": null,
10303 "order": null,
10304 "overflow": null,
10305 "overflow_x": null,
10306 "overflow_y": null,
10307 "padding": null,
10308 "right": null,
10309 "top": null,
10310 "visibility": null,
10311 "width": null
10312 }
10313 },
10314 "67f022dd80234c08849906615a1191dc": {
10315 "model_module": "@jupyter-widgets/controls",
10316 "model_name": "DescriptionStyleModel",
10317 "model_module_version": "1.5.0",
10318 "state": {
10319 "_model_module": "@jupyter-widgets/controls",
10320 "_model_module_version": "1.5.0",
10321 "_model_name": "DescriptionStyleModel",
10322 "_view_count": null,
10323 "_view_module": "@jupyter-widgets/base",
10324 "_view_module_version": "1.2.0",
10325 "_view_name": "StyleView",
10326 "description_width": ""
10327 }
10328 },
10329 "2e5e169b1ad64407ad8c3494a70b314f": {
10330 "model_module": "@jupyter-widgets/base",
10331 "model_name": "LayoutModel",
10332 "model_module_version": "1.2.0",
10333 "state": {
10334 "_model_module": "@jupyter-widgets/base",
10335 "_model_module_version": "1.2.0",
10336 "_model_name": "LayoutModel",
10337 "_view_count": null,
10338 "_view_module": "@jupyter-widgets/base",
10339 "_view_module_version": "1.2.0",
10340 "_view_name": "LayoutView",
10341 "align_content": null,
10342 "align_items": null,
10343 "align_self": null,
10344 "border": null,
10345 "bottom": null,
10346 "display": null,
10347 "flex": "2",
10348 "flex_flow": null,
10349 "grid_area": null,
10350 "grid_auto_columns": null,
10351 "grid_auto_flow": null,
10352 "grid_auto_rows": null,
10353 "grid_column": null,
10354 "grid_gap": null,
10355 "grid_row": null,
10356 "grid_template_areas": null,
10357 "grid_template_columns": null,
10358 "grid_template_rows": null,
10359 "height": null,
10360 "justify_content": null,
10361 "justify_items": null,
10362 "left": null,
10363 "margin": null,
10364 "max_height": null,
10365 "max_width": null,
10366 "min_height": null,
10367 "min_width": null,
10368 "object_fit": null,
10369 "object_position": null,
10370 "order": null,
10371 "overflow": null,
10372 "overflow_x": null,
10373 "overflow_y": null,
10374 "padding": null,
10375 "right": null,
10376 "top": null,
10377 "visibility": null,
10378 "width": null
10379 }
10380 },
10381 "277e7a95b41447b4a52824c212e6fa7c": {
10382 "model_module": "@jupyter-widgets/controls",
10383 "model_name": "ProgressStyleModel",
10384 "model_module_version": "1.5.0",
10385 "state": {
10386 "_model_module": "@jupyter-widgets/controls",
10387 "_model_module_version": "1.5.0",
10388 "_model_name": "ProgressStyleModel",
10389 "_view_count": null,
10390 "_view_module": "@jupyter-widgets/base",
10391 "_view_module_version": "1.2.0",
10392 "_view_name": "StyleView",
10393 "bar_color": null,
10394 "description_width": ""
10395 }
10396 },
10397 "d07c7bcf6a934fae9e015be66a1f860d": {
10398 "model_module": "@jupyter-widgets/base",
10399 "model_name": "LayoutModel",
10400 "model_module_version": "1.2.0",
10401 "state": {
10402 "_model_module": "@jupyter-widgets/base",
10403 "_model_module_version": "1.2.0",
10404 "_model_name": "LayoutModel",
10405 "_view_count": null,
10406 "_view_module": "@jupyter-widgets/base",
10407 "_view_module_version": "1.2.0",
10408 "_view_name": "LayoutView",
10409 "align_content": null,
10410 "align_items": null,
10411 "align_self": null,
10412 "border": null,
10413 "bottom": null,
10414 "display": null,
10415 "flex": null,
10416 "flex_flow": null,
10417 "grid_area": null,
10418 "grid_auto_columns": null,
10419 "grid_auto_flow": null,
10420 "grid_auto_rows": null,
10421 "grid_column": null,
10422 "grid_gap": null,
10423 "grid_row": null,
10424 "grid_template_areas": null,
10425 "grid_template_columns": null,
10426 "grid_template_rows": null,
10427 "height": null,
10428 "justify_content": null,
10429 "justify_items": null,
10430 "left": null,
10431 "margin": null,
10432 "max_height": null,
10433 "max_width": null,
10434 "min_height": null,
10435 "min_width": null,
10436 "object_fit": null,
10437 "object_position": null,
10438 "order": null,
10439 "overflow": null,
10440 "overflow_x": null,
10441 "overflow_y": null,
10442 "padding": null,
10443 "right": null,
10444 "top": null,
10445 "visibility": null,
10446 "width": null
10447 }
10448 },
10449 "c5e484430b0843689d7cfb434d0aa8da": {
10450 "model_module": "@jupyter-widgets/controls",
10451 "model_name": "DescriptionStyleModel",
10452 "model_module_version": "1.5.0",
10453 "state": {
10454 "_model_module": "@jupyter-widgets/controls",
10455 "_model_module_version": "1.5.0",
10456 "_model_name": "DescriptionStyleModel",
10457 "_view_count": null,
10458 "_view_module": "@jupyter-widgets/base",
10459 "_view_module_version": "1.2.0",
10460 "_view_name": "StyleView",
10461 "description_width": ""
10462 }
10463 },
10464 "814e2827e8d647069f05c5b4c89deb52": {
10465 "model_module": "@jupyter-widgets/controls",
10466 "model_name": "HBoxModel",
10467 "model_module_version": "1.5.0",
10468 "state": {
10469 "_dom_classes": [],
10470 "_model_module": "@jupyter-widgets/controls",
10471 "_model_module_version": "1.5.0",
10472 "_model_name": "HBoxModel",
10473 "_view_count": null,
10474 "_view_module": "@jupyter-widgets/controls",
10475 "_view_module_version": "1.5.0",
10476 "_view_name": "HBoxView",
10477 "box_style": "",
10478 "children": [
10479 "IPY_MODEL_0c8b616aecfd4e5e80a0b7c3aabd290f",
10480 "IPY_MODEL_e0f4261c913d42c9a7dcdf79a9914d4a",
10481 "IPY_MODEL_80a819740bb44d589858d4780b100255"
10482 ],
10483 "layout": "IPY_MODEL_5caf7d1fdd564dc2bebe48dd918d9c8f"
10484 }
10485 },
10486 "0c8b616aecfd4e5e80a0b7c3aabd290f": {
10487 "model_module": "@jupyter-widgets/controls",
10488 "model_name": "HTMLModel",
10489 "model_module_version": "1.5.0",
10490 "state": {
10491 "_dom_classes": [],
10492 "_model_module": "@jupyter-widgets/controls",
10493 "_model_module_version": "1.5.0",
10494 "_model_name": "HTMLModel",
10495 "_view_count": null,
10496 "_view_module": "@jupyter-widgets/controls",
10497 "_view_module_version": "1.5.0",
10498 "_view_name": "HTMLView",
10499 "description": "",
10500 "description_tooltip": null,
10501 "layout": "IPY_MODEL_10ab820d989c44b98a8bde85780c3deb",
10502 "placeholder": "​",
10503 "style": "IPY_MODEL_7e787283e4434da6b5d3f9245745547c",
10504 "value": "Validation DataLoader 0: 100%"
10505 }
10506 },
10507 "e0f4261c913d42c9a7dcdf79a9914d4a": {
10508 "model_module": "@jupyter-widgets/controls",
10509 "model_name": "FloatProgressModel",
10510 "model_module_version": "1.5.0",
10511 "state": {
10512 "_dom_classes": [],
10513 "_model_module": "@jupyter-widgets/controls",
10514 "_model_module_version": "1.5.0",
10515 "_model_name": "FloatProgressModel",
10516 "_view_count": null,
10517 "_view_module": "@jupyter-widgets/controls",
10518 "_view_module_version": "1.5.0",
10519 "_view_name": "ProgressView",
10520 "bar_style": "",
10521 "description": "",
10522 "description_tooltip": null,
10523 "layout": "IPY_MODEL_b8c86419aa4f43a3a0c9443f23298c0a",
10524 "max": 1,
10525 "min": 0,
10526 "orientation": "horizontal",
10527 "style": "IPY_MODEL_0270acbb7ed94626adc932afa0655eaa",
10528 "value": 1
10529 }
10530 },
10531 "80a819740bb44d589858d4780b100255": {
10532 "model_module": "@jupyter-widgets/controls",
10533 "model_name": "HTMLModel",
10534 "model_module_version": "1.5.0",
10535 "state": {
10536 "_dom_classes": [],
10537 "_model_module": "@jupyter-widgets/controls",
10538 "_model_module_version": "1.5.0",
10539 "_model_name": "HTMLModel",
10540 "_view_count": null,
10541 "_view_module": "@jupyter-widgets/controls",
10542 "_view_module_version": "1.5.0",
10543 "_view_name": "HTMLView",
10544 "description": "",
10545 "description_tooltip": null,
10546 "layout": "IPY_MODEL_ab0b7e4f05b24205b5e4b9e975cb8e71",
10547 "placeholder": "​",
10548 "style": "IPY_MODEL_70c85ee15c0c4427b6538acbbd0de481",
10549 "value": " 1/1 [00:00&lt;00:00, 116.82it/s]"
10550 }
10551 },
10552 "5caf7d1fdd564dc2bebe48dd918d9c8f": {
10553 "model_module": "@jupyter-widgets/base",
10554 "model_name": "LayoutModel",
10555 "model_module_version": "1.2.0",
10556 "state": {
10557 "_model_module": "@jupyter-widgets/base",
10558 "_model_module_version": "1.2.0",
10559 "_model_name": "LayoutModel",
10560 "_view_count": null,
10561 "_view_module": "@jupyter-widgets/base",
10562 "_view_module_version": "1.2.0",
10563 "_view_name": "LayoutView",
10564 "align_content": null,
10565 "align_items": null,
10566 "align_self": null,
10567 "border": null,
10568 "bottom": null,
10569 "display": "inline-flex",
10570 "flex": null,
10571 "flex_flow": "row wrap",
10572 "grid_area": null,
10573 "grid_auto_columns": null,
10574 "grid_auto_flow": null,
10575 "grid_auto_rows": null,
10576 "grid_column": null,
10577 "grid_gap": null,
10578 "grid_row": null,
10579 "grid_template_areas": null,
10580 "grid_template_columns": null,
10581 "grid_template_rows": null,
10582 "height": null,
10583 "justify_content": null,
10584 "justify_items": null,
10585 "left": null,
10586 "margin": null,
10587 "max_height": null,
10588 "max_width": null,
10589 "min_height": null,
10590 "min_width": null,
10591 "object_fit": null,
10592 "object_position": null,
10593 "order": null,
10594 "overflow": null,
10595 "overflow_x": null,
10596 "overflow_y": null,
10597 "padding": null,
10598 "right": null,
10599 "top": null,
10600 "visibility": null,
10601 "width": "100%"
10602 }
10603 },
10604 "10ab820d989c44b98a8bde85780c3deb": {
10605 "model_module": "@jupyter-widgets/base",
10606 "model_name": "LayoutModel",
10607 "model_module_version": "1.2.0",
10608 "state": {
10609 "_model_module": "@jupyter-widgets/base",
10610 "_model_module_version": "1.2.0",
10611 "_model_name": "LayoutModel",
10612 "_view_count": null,
10613 "_view_module": "@jupyter-widgets/base",
10614 "_view_module_version": "1.2.0",
10615 "_view_name": "LayoutView",
10616 "align_content": null,
10617 "align_items": null,
10618 "align_self": null,
10619 "border": null,
10620 "bottom": null,
10621 "display": null,
10622 "flex": null,
10623 "flex_flow": null,
10624 "grid_area": null,
10625 "grid_auto_columns": null,
10626 "grid_auto_flow": null,
10627 "grid_auto_rows": null,
10628 "grid_column": null,
10629 "grid_gap": null,
10630 "grid_row": null,
10631 "grid_template_areas": null,
10632 "grid_template_columns": null,
10633 "grid_template_rows": null,
10634 "height": null,
10635 "justify_content": null,
10636 "justify_items": null,
10637 "left": null,
10638 "margin": null,
10639 "max_height": null,
10640 "max_width": null,
10641 "min_height": null,
10642 "min_width": null,
10643 "object_fit": null,
10644 "object_position": null,
10645 "order": null,
10646 "overflow": null,
10647 "overflow_x": null,
10648 "overflow_y": null,
10649 "padding": null,
10650 "right": null,
10651 "top": null,
10652 "visibility": null,
10653 "width": null
10654 }
10655 },
10656 "7e787283e4434da6b5d3f9245745547c": {
10657 "model_module": "@jupyter-widgets/controls",
10658 "model_name": "DescriptionStyleModel",
10659 "model_module_version": "1.5.0",
10660 "state": {
10661 "_model_module": "@jupyter-widgets/controls",
10662 "_model_module_version": "1.5.0",
10663 "_model_name": "DescriptionStyleModel",
10664 "_view_count": null,
10665 "_view_module": "@jupyter-widgets/base",
10666 "_view_module_version": "1.2.0",
10667 "_view_name": "StyleView",
10668 "description_width": ""
10669 }
10670 },
10671 "b8c86419aa4f43a3a0c9443f23298c0a": {
10672 "model_module": "@jupyter-widgets/base",
10673 "model_name": "LayoutModel",
10674 "model_module_version": "1.2.0",
10675 "state": {
10676 "_model_module": "@jupyter-widgets/base",
10677 "_model_module_version": "1.2.0",
10678 "_model_name": "LayoutModel",
10679 "_view_count": null,
10680 "_view_module": "@jupyter-widgets/base",
10681 "_view_module_version": "1.2.0",
10682 "_view_name": "LayoutView",
10683 "align_content": null,
10684 "align_items": null,
10685 "align_self": null,
10686 "border": null,
10687 "bottom": null,
10688 "display": null,
10689 "flex": "2",
10690 "flex_flow": null,
10691 "grid_area": null,
10692 "grid_auto_columns": null,
10693 "grid_auto_flow": null,
10694 "grid_auto_rows": null,
10695 "grid_column": null,
10696 "grid_gap": null,
10697 "grid_row": null,
10698 "grid_template_areas": null,
10699 "grid_template_columns": null,
10700 "grid_template_rows": null,
10701 "height": null,
10702 "justify_content": null,
10703 "justify_items": null,
10704 "left": null,
10705 "margin": null,
10706 "max_height": null,
10707 "max_width": null,
10708 "min_height": null,
10709 "min_width": null,
10710 "object_fit": null,
10711 "object_position": null,
10712 "order": null,
10713 "overflow": null,
10714 "overflow_x": null,
10715 "overflow_y": null,
10716 "padding": null,
10717 "right": null,
10718 "top": null,
10719 "visibility": null,
10720 "width": null
10721 }
10722 },
10723 "0270acbb7ed94626adc932afa0655eaa": {
10724 "model_module": "@jupyter-widgets/controls",
10725 "model_name": "ProgressStyleModel",
10726 "model_module_version": "1.5.0",
10727 "state": {
10728 "_model_module": "@jupyter-widgets/controls",
10729 "_model_module_version": "1.5.0",
10730 "_model_name": "ProgressStyleModel",
10731 "_view_count": null,
10732 "_view_module": "@jupyter-widgets/base",
10733 "_view_module_version": "1.2.0",
10734 "_view_name": "StyleView",
10735 "bar_color": null,
10736 "description_width": ""
10737 }
10738 },
10739 "ab0b7e4f05b24205b5e4b9e975cb8e71": {
10740 "model_module": "@jupyter-widgets/base",
10741 "model_name": "LayoutModel",
10742 "model_module_version": "1.2.0",
10743 "state": {
10744 "_model_module": "@jupyter-widgets/base",
10745 "_model_module_version": "1.2.0",
10746 "_model_name": "LayoutModel",
10747 "_view_count": null,
10748 "_view_module": "@jupyter-widgets/base",
10749 "_view_module_version": "1.2.0",
10750 "_view_name": "LayoutView",
10751 "align_content": null,
10752 "align_items": null,
10753 "align_self": null,
10754 "border": null,
10755 "bottom": null,
10756 "display": null,
10757 "flex": null,
10758 "flex_flow": null,
10759 "grid_area": null,
10760 "grid_auto_columns": null,
10761 "grid_auto_flow": null,
10762 "grid_auto_rows": null,
10763 "grid_column": null,
10764 "grid_gap": null,
10765 "grid_row": null,
10766 "grid_template_areas": null,
10767 "grid_template_columns": null,
10768 "grid_template_rows": null,
10769 "height": null,
10770 "justify_content": null,
10771 "justify_items": null,
10772 "left": null,
10773 "margin": null,
10774 "max_height": null,
10775 "max_width": null,
10776 "min_height": null,
10777 "min_width": null,
10778 "object_fit": null,
10779 "object_position": null,
10780 "order": null,
10781 "overflow": null,
10782 "overflow_x": null,
10783 "overflow_y": null,
10784 "padding": null,
10785 "right": null,
10786 "top": null,
10787 "visibility": null,
10788 "width": null
10789 }
10790 },
10791 "70c85ee15c0c4427b6538acbbd0de481": {
10792 "model_module": "@jupyter-widgets/controls",
10793 "model_name": "DescriptionStyleModel",
10794 "model_module_version": "1.5.0",
10795 "state": {
10796 "_model_module": "@jupyter-widgets/controls",
10797 "_model_module_version": "1.5.0",
10798 "_model_name": "DescriptionStyleModel",
10799 "_view_count": null,
10800 "_view_module": "@jupyter-widgets/base",
10801 "_view_module_version": "1.2.0",
10802 "_view_name": "StyleView",
10803 "description_width": ""
10804 }
10805 },
10806 "b38c3345647c4db68a2321e3a4d9e215": {
10807 "model_module": "@jupyter-widgets/controls",
10808 "model_name": "HBoxModel",
10809 "model_module_version": "1.5.0",
10810 "state": {
10811 "_dom_classes": [],
10812 "_model_module": "@jupyter-widgets/controls",
10813 "_model_module_version": "1.5.0",
10814 "_model_name": "HBoxModel",
10815 "_view_count": null,
10816 "_view_module": "@jupyter-widgets/controls",
10817 "_view_module_version": "1.5.0",
10818 "_view_name": "HBoxView",
10819 "box_style": "",
10820 "children": [
10821 "IPY_MODEL_8c7b852936ca400aa04ec3f95e9afcb3",
10822 "IPY_MODEL_3099fea4c655407582c196176cc2108c",
10823 "IPY_MODEL_a5cb3ea273f9454fbb9dcd8877f2aa33"
10824 ],
10825 "layout": "IPY_MODEL_b4a722f06b614e9cbb259c8fa1e9f664"
10826 }
10827 },
10828 "8c7b852936ca400aa04ec3f95e9afcb3": {
10829 "model_module": "@jupyter-widgets/controls",
10830 "model_name": "HTMLModel",
10831 "model_module_version": "1.5.0",
10832 "state": {
10833 "_dom_classes": [],
10834 "_model_module": "@jupyter-widgets/controls",
10835 "_model_module_version": "1.5.0",
10836 "_model_name": "HTMLModel",
10837 "_view_count": null,
10838 "_view_module": "@jupyter-widgets/controls",
10839 "_view_module_version": "1.5.0",
10840 "_view_name": "HTMLView",
10841 "description": "",
10842 "description_tooltip": null,
10843 "layout": "IPY_MODEL_228014c8ccd543a6af4c554cf60137bf",
10844 "placeholder": "​",
10845 "style": "IPY_MODEL_6e7ea147348f40c8acc919af41047189",
10846 "value": "Validation DataLoader 0: 100%"
10847 }
10848 },
10849 "3099fea4c655407582c196176cc2108c": {
10850 "model_module": "@jupyter-widgets/controls",
10851 "model_name": "FloatProgressModel",
10852 "model_module_version": "1.5.0",
10853 "state": {
10854 "_dom_classes": [],
10855 "_model_module": "@jupyter-widgets/controls",
10856 "_model_module_version": "1.5.0",
10857 "_model_name": "FloatProgressModel",
10858 "_view_count": null,
10859 "_view_module": "@jupyter-widgets/controls",
10860 "_view_module_version": "1.5.0",
10861 "_view_name": "ProgressView",
10862 "bar_style": "",
10863 "description": "",
10864 "description_tooltip": null,
10865 "layout": "IPY_MODEL_7c315c5b62e14d2c9af6fecf536d8df5",
10866 "max": 1,
10867 "min": 0,
10868 "orientation": "horizontal",
10869 "style": "IPY_MODEL_a9e1b08f5ff24e1b8d652cd9ad649b54",
10870 "value": 1
10871 }
10872 },
10873 "a5cb3ea273f9454fbb9dcd8877f2aa33": {
10874 "model_module": "@jupyter-widgets/controls",
10875 "model_name": "HTMLModel",
10876 "model_module_version": "1.5.0",
10877 "state": {
10878 "_dom_classes": [],
10879 "_model_module": "@jupyter-widgets/controls",
10880 "_model_module_version": "1.5.0",
10881 "_model_name": "HTMLModel",
10882 "_view_count": null,
10883 "_view_module": "@jupyter-widgets/controls",
10884 "_view_module_version": "1.5.0",
10885 "_view_name": "HTMLView",
10886 "description": "",
10887 "description_tooltip": null,
10888 "layout": "IPY_MODEL_df097748d93e4254be82e6dae9696167",
10889 "placeholder": "​",
10890 "style": "IPY_MODEL_ac30029d30c34fd58a7f3d1826d94d6b",
10891 "value": " 1/1 [00:00&lt;00:00, 110.19it/s]"
10892 }
10893 },
10894 "b4a722f06b614e9cbb259c8fa1e9f664": {
10895 "model_module": "@jupyter-widgets/base",
10896 "model_name": "LayoutModel",
10897 "model_module_version": "1.2.0",
10898 "state": {
10899 "_model_module": "@jupyter-widgets/base",
10900 "_model_module_version": "1.2.0",
10901 "_model_name": "LayoutModel",
10902 "_view_count": null,
10903 "_view_module": "@jupyter-widgets/base",
10904 "_view_module_version": "1.2.0",
10905 "_view_name": "LayoutView",
10906 "align_content": null,
10907 "align_items": null,
10908 "align_self": null,
10909 "border": null,
10910 "bottom": null,
10911 "display": "inline-flex",
10912 "flex": null,
10913 "flex_flow": "row wrap",
10914 "grid_area": null,
10915 "grid_auto_columns": null,
10916 "grid_auto_flow": null,
10917 "grid_auto_rows": null,
10918 "grid_column": null,
10919 "grid_gap": null,
10920 "grid_row": null,
10921 "grid_template_areas": null,
10922 "grid_template_columns": null,
10923 "grid_template_rows": null,
10924 "height": null,
10925 "justify_content": null,
10926 "justify_items": null,
10927 "left": null,
10928 "margin": null,
10929 "max_height": null,
10930 "max_width": null,
10931 "min_height": null,
10932 "min_width": null,
10933 "object_fit": null,
10934 "object_position": null,
10935 "order": null,
10936 "overflow": null,
10937 "overflow_x": null,
10938 "overflow_y": null,
10939 "padding": null,
10940 "right": null,
10941 "top": null,
10942 "visibility": null,
10943 "width": "100%"
10944 }
10945 },
10946 "228014c8ccd543a6af4c554cf60137bf": {
10947 "model_module": "@jupyter-widgets/base",
10948 "model_name": "LayoutModel",
10949 "model_module_version": "1.2.0",
10950 "state": {
10951 "_model_module": "@jupyter-widgets/base",
10952 "_model_module_version": "1.2.0",
10953 "_model_name": "LayoutModel",
10954 "_view_count": null,
10955 "_view_module": "@jupyter-widgets/base",
10956 "_view_module_version": "1.2.0",
10957 "_view_name": "LayoutView",
10958 "align_content": null,
10959 "align_items": null,
10960 "align_self": null,
10961 "border": null,
10962 "bottom": null,
10963 "display": null,
10964 "flex": null,
10965 "flex_flow": null,
10966 "grid_area": null,
10967 "grid_auto_columns": null,
10968 "grid_auto_flow": null,
10969 "grid_auto_rows": null,
10970 "grid_column": null,
10971 "grid_gap": null,
10972 "grid_row": null,
10973 "grid_template_areas": null,
10974 "grid_template_columns": null,
10975 "grid_template_rows": null,
10976 "height": null,
10977 "justify_content": null,
10978 "justify_items": null,
10979 "left": null,
10980 "margin": null,
10981 "max_height": null,
10982 "max_width": null,
10983 "min_height": null,
10984 "min_width": null,
10985 "object_fit": null,
10986 "object_position": null,
10987 "order": null,
10988 "overflow": null,
10989 "overflow_x": null,
10990 "overflow_y": null,
10991 "padding": null,
10992 "right": null,
10993 "top": null,
10994 "visibility": null,
10995 "width": null
10996 }
10997 },
10998 "6e7ea147348f40c8acc919af41047189": {
10999 "model_module": "@jupyter-widgets/controls",
11000 "model_name": "DescriptionStyleModel",
11001 "model_module_version": "1.5.0",
11002 "state": {
11003 "_model_module": "@jupyter-widgets/controls",
11004 "_model_module_version": "1.5.0",
11005 "_model_name": "DescriptionStyleModel",
11006 "_view_count": null,
11007 "_view_module": "@jupyter-widgets/base",
11008 "_view_module_version": "1.2.0",
11009 "_view_name": "StyleView",
11010 "description_width": ""
11011 }
11012 },
11013 "7c315c5b62e14d2c9af6fecf536d8df5": {
11014 "model_module": "@jupyter-widgets/base",
11015 "model_name": "LayoutModel",
11016 "model_module_version": "1.2.0",
11017 "state": {
11018 "_model_module": "@jupyter-widgets/base",
11019 "_model_module_version": "1.2.0",
11020 "_model_name": "LayoutModel",
11021 "_view_count": null,
11022 "_view_module": "@jupyter-widgets/base",
11023 "_view_module_version": "1.2.0",
11024 "_view_name": "LayoutView",
11025 "align_content": null,
11026 "align_items": null,
11027 "align_self": null,
11028 "border": null,
11029 "bottom": null,
11030 "display": null,
11031 "flex": "2",
11032 "flex_flow": null,
11033 "grid_area": null,
11034 "grid_auto_columns": null,
11035 "grid_auto_flow": null,
11036 "grid_auto_rows": null,
11037 "grid_column": null,
11038 "grid_gap": null,
11039 "grid_row": null,
11040 "grid_template_areas": null,
11041 "grid_template_columns": null,
11042 "grid_template_rows": null,
11043 "height": null,
11044 "justify_content": null,
11045 "justify_items": null,
11046 "left": null,
11047 "margin": null,
11048 "max_height": null,
11049 "max_width": null,
11050 "min_height": null,
11051 "min_width": null,
11052 "object_fit": null,
11053 "object_position": null,
11054 "order": null,
11055 "overflow": null,
11056 "overflow_x": null,
11057 "overflow_y": null,
11058 "padding": null,
11059 "right": null,
11060 "top": null,
11061 "visibility": null,
11062 "width": null
11063 }
11064 },
11065 "a9e1b08f5ff24e1b8d652cd9ad649b54": {
11066 "model_module": "@jupyter-widgets/controls",
11067 "model_name": "ProgressStyleModel",
11068 "model_module_version": "1.5.0",
11069 "state": {
11070 "_model_module": "@jupyter-widgets/controls",
11071 "_model_module_version": "1.5.0",
11072 "_model_name": "ProgressStyleModel",
11073 "_view_count": null,
11074 "_view_module": "@jupyter-widgets/base",
11075 "_view_module_version": "1.2.0",
11076 "_view_name": "StyleView",
11077 "bar_color": null,
11078 "description_width": ""
11079 }
11080 },
11081 "df097748d93e4254be82e6dae9696167": {
11082 "model_module": "@jupyter-widgets/base",
11083 "model_name": "LayoutModel",
11084 "model_module_version": "1.2.0",
11085 "state": {
11086 "_model_module": "@jupyter-widgets/base",
11087 "_model_module_version": "1.2.0",
11088 "_model_name": "LayoutModel",
11089 "_view_count": null,
11090 "_view_module": "@jupyter-widgets/base",
11091 "_view_module_version": "1.2.0",
11092 "_view_name": "LayoutView",
11093 "align_content": null,
11094 "align_items": null,
11095 "align_self": null,
11096 "border": null,
11097 "bottom": null,
11098 "display": null,
11099 "flex": null,
11100 "flex_flow": null,
11101 "grid_area": null,
11102 "grid_auto_columns": null,
11103 "grid_auto_flow": null,
11104 "grid_auto_rows": null,
11105 "grid_column": null,
11106 "grid_gap": null,
11107 "grid_row": null,
11108 "grid_template_areas": null,
11109 "grid_template_columns": null,
11110 "grid_template_rows": null,
11111 "height": null,
11112 "justify_content": null,
11113 "justify_items": null,
11114 "left": null,
11115 "margin": null,
11116 "max_height": null,
11117 "max_width": null,
11118 "min_height": null,
11119 "min_width": null,
11120 "object_fit": null,
11121 "object_position": null,
11122 "order": null,
11123 "overflow": null,
11124 "overflow_x": null,
11125 "overflow_y": null,
11126 "padding": null,
11127 "right": null,
11128 "top": null,
11129 "visibility": null,
11130 "width": null
11131 }
11132 },
11133 "ac30029d30c34fd58a7f3d1826d94d6b": {
11134 "model_module": "@jupyter-widgets/controls",
11135 "model_name": "DescriptionStyleModel",
11136 "model_module_version": "1.5.0",
11137 "state": {
11138 "_model_module": "@jupyter-widgets/controls",
11139 "_model_module_version": "1.5.0",
11140 "_model_name": "DescriptionStyleModel",
11141 "_view_count": null,
11142 "_view_module": "@jupyter-widgets/base",
11143 "_view_module_version": "1.2.0",
11144 "_view_name": "StyleView",
11145 "description_width": ""
11146 }
11147 },
11148 "6daac3cee4b9409cba48efa0d06bee24": {
11149 "model_module": "@jupyter-widgets/controls",
11150 "model_name": "HBoxModel",
11151 "model_module_version": "1.5.0",
11152 "state": {
11153 "_dom_classes": [],
11154 "_model_module": "@jupyter-widgets/controls",
11155 "_model_module_version": "1.5.0",
11156 "_model_name": "HBoxModel",
11157 "_view_count": null,
11158 "_view_module": "@jupyter-widgets/controls",
11159 "_view_module_version": "1.5.0",
11160 "_view_name": "HBoxView",
11161 "box_style": "",
11162 "children": [
11163 "IPY_MODEL_db45da82b3594a1db11322289253a132",
11164 "IPY_MODEL_d4891374cfde42adac3f2218b879f082",
11165 "IPY_MODEL_2a009696a36748b2937ac6746460483a"
11166 ],
11167 "layout": "IPY_MODEL_979c7269c8394082b277435040052f45"
11168 }
11169 },
11170 "db45da82b3594a1db11322289253a132": {
11171 "model_module": "@jupyter-widgets/controls",
11172 "model_name": "HTMLModel",
11173 "model_module_version": "1.5.0",
11174 "state": {
11175 "_dom_classes": [],
11176 "_model_module": "@jupyter-widgets/controls",
11177 "_model_module_version": "1.5.0",
11178 "_model_name": "HTMLModel",
11179 "_view_count": null,
11180 "_view_module": "@jupyter-widgets/controls",
11181 "_view_module_version": "1.5.0",
11182 "_view_name": "HTMLView",
11183 "description": "",
11184 "description_tooltip": null,
11185 "layout": "IPY_MODEL_42ff3dacbeb34fc79e60d382c93180d6",
11186 "placeholder": "​",
11187 "style": "IPY_MODEL_d5156d7ec0e14a60bc67ac5e3c5b32a6",
11188 "value": "Validation DataLoader 0: 100%"
11189 }
11190 },
11191 "d4891374cfde42adac3f2218b879f082": {
11192 "model_module": "@jupyter-widgets/controls",
11193 "model_name": "FloatProgressModel",
11194 "model_module_version": "1.5.0",
11195 "state": {
11196 "_dom_classes": [],
11197 "_model_module": "@jupyter-widgets/controls",
11198 "_model_module_version": "1.5.0",
11199 "_model_name": "FloatProgressModel",
11200 "_view_count": null,
11201 "_view_module": "@jupyter-widgets/controls",
11202 "_view_module_version": "1.5.0",
11203 "_view_name": "ProgressView",
11204 "bar_style": "",
11205 "description": "",
11206 "description_tooltip": null,
11207 "layout": "IPY_MODEL_e82400379100428a915968d7ba060fd5",
11208 "max": 1,
11209 "min": 0,
11210 "orientation": "horizontal",
11211 "style": "IPY_MODEL_f25f7aabffb046a388ba71ad7c3ab7de",
11212 "value": 1
11213 }
11214 },
11215 "2a009696a36748b2937ac6746460483a": {
11216 "model_module": "@jupyter-widgets/controls",
11217 "model_name": "HTMLModel",
11218 "model_module_version": "1.5.0",
11219 "state": {
11220 "_dom_classes": [],
11221 "_model_module": "@jupyter-widgets/controls",
11222 "_model_module_version": "1.5.0",
11223 "_model_name": "HTMLModel",
11224 "_view_count": null,
11225 "_view_module": "@jupyter-widgets/controls",
11226 "_view_module_version": "1.5.0",
11227 "_view_name": "HTMLView",
11228 "description": "",
11229 "description_tooltip": null,
11230 "layout": "IPY_MODEL_5088dea18c1146d8841e50e76697b7e5",
11231 "placeholder": "​",
11232 "style": "IPY_MODEL_e36d59055aee4a48b521109b96c9faff",
11233 "value": " 1/1 [00:00&lt;00:00, 188.47it/s]"
11234 }
11235 },
11236 "979c7269c8394082b277435040052f45": {
11237 "model_module": "@jupyter-widgets/base",
11238 "model_name": "LayoutModel",
11239 "model_module_version": "1.2.0",
11240 "state": {
11241 "_model_module": "@jupyter-widgets/base",
11242 "_model_module_version": "1.2.0",
11243 "_model_name": "LayoutModel",
11244 "_view_count": null,
11245 "_view_module": "@jupyter-widgets/base",
11246 "_view_module_version": "1.2.0",
11247 "_view_name": "LayoutView",
11248 "align_content": null,
11249 "align_items": null,
11250 "align_self": null,
11251 "border": null,
11252 "bottom": null,
11253 "display": "inline-flex",
11254 "flex": null,
11255 "flex_flow": "row wrap",
11256 "grid_area": null,
11257 "grid_auto_columns": null,
11258 "grid_auto_flow": null,
11259 "grid_auto_rows": null,
11260 "grid_column": null,
11261 "grid_gap": null,
11262 "grid_row": null,
11263 "grid_template_areas": null,
11264 "grid_template_columns": null,
11265 "grid_template_rows": null,
11266 "height": null,
11267 "justify_content": null,
11268 "justify_items": null,
11269 "left": null,
11270 "margin": null,
11271 "max_height": null,
11272 "max_width": null,
11273 "min_height": null,
11274 "min_width": null,
11275 "object_fit": null,
11276 "object_position": null,
11277 "order": null,
11278 "overflow": null,
11279 "overflow_x": null,
11280 "overflow_y": null,
11281 "padding": null,
11282 "right": null,
11283 "top": null,
11284 "visibility": null,
11285 "width": "100%"
11286 }
11287 },
11288 "42ff3dacbeb34fc79e60d382c93180d6": {
11289 "model_module": "@jupyter-widgets/base",
11290 "model_name": "LayoutModel",
11291 "model_module_version": "1.2.0",
11292 "state": {
11293 "_model_module": "@jupyter-widgets/base",
11294 "_model_module_version": "1.2.0",
11295 "_model_name": "LayoutModel",
11296 "_view_count": null,
11297 "_view_module": "@jupyter-widgets/base",
11298 "_view_module_version": "1.2.0",
11299 "_view_name": "LayoutView",
11300 "align_content": null,
11301 "align_items": null,
11302 "align_self": null,
11303 "border": null,
11304 "bottom": null,
11305 "display": null,
11306 "flex": null,
11307 "flex_flow": null,
11308 "grid_area": null,
11309 "grid_auto_columns": null,
11310 "grid_auto_flow": null,
11311 "grid_auto_rows": null,
11312 "grid_column": null,
11313 "grid_gap": null,
11314 "grid_row": null,
11315 "grid_template_areas": null,
11316 "grid_template_columns": null,
11317 "grid_template_rows": null,
11318 "height": null,
11319 "justify_content": null,
11320 "justify_items": null,
11321 "left": null,
11322 "margin": null,
11323 "max_height": null,
11324 "max_width": null,
11325 "min_height": null,
11326 "min_width": null,
11327 "object_fit": null,
11328 "object_position": null,
11329 "order": null,
11330 "overflow": null,
11331 "overflow_x": null,
11332 "overflow_y": null,
11333 "padding": null,
11334 "right": null,
11335 "top": null,
11336 "visibility": null,
11337 "width": null
11338 }
11339 },
11340 "d5156d7ec0e14a60bc67ac5e3c5b32a6": {
11341 "model_module": "@jupyter-widgets/controls",
11342 "model_name": "DescriptionStyleModel",
11343 "model_module_version": "1.5.0",
11344 "state": {
11345 "_model_module": "@jupyter-widgets/controls",
11346 "_model_module_version": "1.5.0",
11347 "_model_name": "DescriptionStyleModel",
11348 "_view_count": null,
11349 "_view_module": "@jupyter-widgets/base",
11350 "_view_module_version": "1.2.0",
11351 "_view_name": "StyleView",
11352 "description_width": ""
11353 }
11354 },
11355 "e82400379100428a915968d7ba060fd5": {
11356 "model_module": "@jupyter-widgets/base",
11357 "model_name": "LayoutModel",
11358 "model_module_version": "1.2.0",
11359 "state": {
11360 "_model_module": "@jupyter-widgets/base",
11361 "_model_module_version": "1.2.0",
11362 "_model_name": "LayoutModel",
11363 "_view_count": null,
11364 "_view_module": "@jupyter-widgets/base",
11365 "_view_module_version": "1.2.0",
11366 "_view_name": "LayoutView",
11367 "align_content": null,
11368 "align_items": null,
11369 "align_self": null,
11370 "border": null,
11371 "bottom": null,
11372 "display": null,
11373 "flex": "2",
11374 "flex_flow": null,
11375 "grid_area": null,
11376 "grid_auto_columns": null,
11377 "grid_auto_flow": null,
11378 "grid_auto_rows": null,
11379 "grid_column": null,
11380 "grid_gap": null,
11381 "grid_row": null,
11382 "grid_template_areas": null,
11383 "grid_template_columns": null,
11384 "grid_template_rows": null,
11385 "height": null,
11386 "justify_content": null,
11387 "justify_items": null,
11388 "left": null,
11389 "margin": null,
11390 "max_height": null,
11391 "max_width": null,
11392 "min_height": null,
11393 "min_width": null,
11394 "object_fit": null,
11395 "object_position": null,
11396 "order": null,
11397 "overflow": null,
11398 "overflow_x": null,
11399 "overflow_y": null,
11400 "padding": null,
11401 "right": null,
11402 "top": null,
11403 "visibility": null,
11404 "width": null
11405 }
11406 },
11407 "f25f7aabffb046a388ba71ad7c3ab7de": {
11408 "model_module": "@jupyter-widgets/controls",
11409 "model_name": "ProgressStyleModel",
11410 "model_module_version": "1.5.0",
11411 "state": {
11412 "_model_module": "@jupyter-widgets/controls",
11413 "_model_module_version": "1.5.0",
11414 "_model_name": "ProgressStyleModel",
11415 "_view_count": null,
11416 "_view_module": "@jupyter-widgets/base",
11417 "_view_module_version": "1.2.0",
11418 "_view_name": "StyleView",
11419 "bar_color": null,
11420 "description_width": ""
11421 }
11422 },
11423 "5088dea18c1146d8841e50e76697b7e5": {
11424 "model_module": "@jupyter-widgets/base",
11425 "model_name": "LayoutModel",
11426 "model_module_version": "1.2.0",
11427 "state": {
11428 "_model_module": "@jupyter-widgets/base",
11429 "_model_module_version": "1.2.0",
11430 "_model_name": "LayoutModel",
11431 "_view_count": null,
11432 "_view_module": "@jupyter-widgets/base",
11433 "_view_module_version": "1.2.0",
11434 "_view_name": "LayoutView",
11435 "align_content": null,
11436 "align_items": null,
11437 "align_self": null,
11438 "border": null,
11439 "bottom": null,
11440 "display": null,
11441 "flex": null,
11442 "flex_flow": null,
11443 "grid_area": null,
11444 "grid_auto_columns": null,
11445 "grid_auto_flow": null,
11446 "grid_auto_rows": null,
11447 "grid_column": null,
11448 "grid_gap": null,
11449 "grid_row": null,
11450 "grid_template_areas": null,
11451 "grid_template_columns": null,
11452 "grid_template_rows": null,
11453 "height": null,
11454 "justify_content": null,
11455 "justify_items": null,
11456 "left": null,
11457 "margin": null,
11458 "max_height": null,
11459 "max_width": null,
11460 "min_height": null,
11461 "min_width": null,
11462 "object_fit": null,
11463 "object_position": null,
11464 "order": null,
11465 "overflow": null,
11466 "overflow_x": null,
11467 "overflow_y": null,
11468 "padding": null,
11469 "right": null,
11470 "top": null,
11471 "visibility": null,
11472 "width": null
11473 }
11474 },
11475 "e36d59055aee4a48b521109b96c9faff": {
11476 "model_module": "@jupyter-widgets/controls",
11477 "model_name": "DescriptionStyleModel",
11478 "model_module_version": "1.5.0",
11479 "state": {
11480 "_model_module": "@jupyter-widgets/controls",
11481 "_model_module_version": "1.5.0",
11482 "_model_name": "DescriptionStyleModel",
11483 "_view_count": null,
11484 "_view_module": "@jupyter-widgets/base",
11485 "_view_module_version": "1.2.0",
11486 "_view_name": "StyleView",
11487 "description_width": ""
11488 }
11489 },
11490 "d4b061b8a44646a8b4ccc4839fe769a8": {
11491 "model_module": "@jupyter-widgets/controls",
11492 "model_name": "HBoxModel",
11493 "model_module_version": "1.5.0",
11494 "state": {
11495 "_dom_classes": [],
11496 "_model_module": "@jupyter-widgets/controls",
11497 "_model_module_version": "1.5.0",
11498 "_model_name": "HBoxModel",
11499 "_view_count": null,
11500 "_view_module": "@jupyter-widgets/controls",
11501 "_view_module_version": "1.5.0",
11502 "_view_name": "HBoxView",
11503 "box_style": "",
11504 "children": [
11505 "IPY_MODEL_354425d2d3cc4be4891499c8c252e585",
11506 "IPY_MODEL_84c2e850cd944480bf1cc9bd79ca40f4",
11507 "IPY_MODEL_ecb0caf0ebd2458789aee04fd0468723"
11508 ],
11509 "layout": "IPY_MODEL_0689a7b924674988a587d498cb946549"
11510 }
11511 },
11512 "354425d2d3cc4be4891499c8c252e585": {
11513 "model_module": "@jupyter-widgets/controls",
11514 "model_name": "HTMLModel",
11515 "model_module_version": "1.5.0",
11516 "state": {
11517 "_dom_classes": [],
11518 "_model_module": "@jupyter-widgets/controls",
11519 "_model_module_version": "1.5.0",
11520 "_model_name": "HTMLModel",
11521 "_view_count": null,
11522 "_view_module": "@jupyter-widgets/controls",
11523 "_view_module_version": "1.5.0",
11524 "_view_name": "HTMLView",
11525 "description": "",
11526 "description_tooltip": null,
11527 "layout": "IPY_MODEL_ea131342791043d48673da5ccb559c26",
11528 "placeholder": "​",
11529 "style": "IPY_MODEL_6936e031b7f74f45998232f819666b45",
11530 "value": "Validation DataLoader 0: 100%"
11531 }
11532 },
11533 "84c2e850cd944480bf1cc9bd79ca40f4": {
11534 "model_module": "@jupyter-widgets/controls",
11535 "model_name": "FloatProgressModel",
11536 "model_module_version": "1.5.0",
11537 "state": {
11538 "_dom_classes": [],
11539 "_model_module": "@jupyter-widgets/controls",
11540 "_model_module_version": "1.5.0",
11541 "_model_name": "FloatProgressModel",
11542 "_view_count": null,
11543 "_view_module": "@jupyter-widgets/controls",
11544 "_view_module_version": "1.5.0",
11545 "_view_name": "ProgressView",
11546 "bar_style": "",
11547 "description": "",
11548 "description_tooltip": null,
11549 "layout": "IPY_MODEL_ae8efd2c29bb4008a13be5b0483928b4",
11550 "max": 1,
11551 "min": 0,
11552 "orientation": "horizontal",
11553 "style": "IPY_MODEL_7728374b25ec4b45b3d9171e69173bf5",
11554 "value": 1
11555 }
11556 },
11557 "ecb0caf0ebd2458789aee04fd0468723": {
11558 "model_module": "@jupyter-widgets/controls",
11559 "model_name": "HTMLModel",
11560 "model_module_version": "1.5.0",
11561 "state": {
11562 "_dom_classes": [],
11563 "_model_module": "@jupyter-widgets/controls",
11564 "_model_module_version": "1.5.0",
11565 "_model_name": "HTMLModel",
11566 "_view_count": null,
11567 "_view_module": "@jupyter-widgets/controls",
11568 "_view_module_version": "1.5.0",
11569 "_view_name": "HTMLView",
11570 "description": "",
11571 "description_tooltip": null,
11572 "layout": "IPY_MODEL_a7456e34baef4c89979963a8e61b98e4",
11573 "placeholder": "​",
11574 "style": "IPY_MODEL_1db1f8a2985947639120d9bccdf3208e",
11575 "value": " 1/1 [00:00&lt;00:00, 113.24it/s]"
11576 }
11577 },
11578 "0689a7b924674988a587d498cb946549": {
11579 "model_module": "@jupyter-widgets/base",
11580 "model_name": "LayoutModel",
11581 "model_module_version": "1.2.0",
11582 "state": {
11583 "_model_module": "@jupyter-widgets/base",
11584 "_model_module_version": "1.2.0",
11585 "_model_name": "LayoutModel",
11586 "_view_count": null,
11587 "_view_module": "@jupyter-widgets/base",
11588 "_view_module_version": "1.2.0",
11589 "_view_name": "LayoutView",
11590 "align_content": null,
11591 "align_items": null,
11592 "align_self": null,
11593 "border": null,
11594 "bottom": null,
11595 "display": "inline-flex",
11596 "flex": null,
11597 "flex_flow": "row wrap",
11598 "grid_area": null,
11599 "grid_auto_columns": null,
11600 "grid_auto_flow": null,
11601 "grid_auto_rows": null,
11602 "grid_column": null,
11603 "grid_gap": null,
11604 "grid_row": null,
11605 "grid_template_areas": null,
11606 "grid_template_columns": null,
11607 "grid_template_rows": null,
11608 "height": null,
11609 "justify_content": null,
11610 "justify_items": null,
11611 "left": null,
11612 "margin": null,
11613 "max_height": null,
11614 "max_width": null,
11615 "min_height": null,
11616 "min_width": null,
11617 "object_fit": null,
11618 "object_position": null,
11619 "order": null,
11620 "overflow": null,
11621 "overflow_x": null,
11622 "overflow_y": null,
11623 "padding": null,
11624 "right": null,
11625 "top": null,
11626 "visibility": null,
11627 "width": "100%"
11628 }
11629 },
11630 "ea131342791043d48673da5ccb559c26": {
11631 "model_module": "@jupyter-widgets/base",
11632 "model_name": "LayoutModel",
11633 "model_module_version": "1.2.0",
11634 "state": {
11635 "_model_module": "@jupyter-widgets/base",
11636 "_model_module_version": "1.2.0",
11637 "_model_name": "LayoutModel",
11638 "_view_count": null,
11639 "_view_module": "@jupyter-widgets/base",
11640 "_view_module_version": "1.2.0",
11641 "_view_name": "LayoutView",
11642 "align_content": null,
11643 "align_items": null,
11644 "align_self": null,
11645 "border": null,
11646 "bottom": null,
11647 "display": null,
11648 "flex": null,
11649 "flex_flow": null,
11650 "grid_area": null,
11651 "grid_auto_columns": null,
11652 "grid_auto_flow": null,
11653 "grid_auto_rows": null,
11654 "grid_column": null,
11655 "grid_gap": null,
11656 "grid_row": null,
11657 "grid_template_areas": null,
11658 "grid_template_columns": null,
11659 "grid_template_rows": null,
11660 "height": null,
11661 "justify_content": null,
11662 "justify_items": null,
11663 "left": null,
11664 "margin": null,
11665 "max_height": null,
11666 "max_width": null,
11667 "min_height": null,
11668 "min_width": null,
11669 "object_fit": null,
11670 "object_position": null,
11671 "order": null,
11672 "overflow": null,
11673 "overflow_x": null,
11674 "overflow_y": null,
11675 "padding": null,
11676 "right": null,
11677 "top": null,
11678 "visibility": null,
11679 "width": null
11680 }
11681 },
11682 "6936e031b7f74f45998232f819666b45": {
11683 "model_module": "@jupyter-widgets/controls",
11684 "model_name": "DescriptionStyleModel",
11685 "model_module_version": "1.5.0",
11686 "state": {
11687 "_model_module": "@jupyter-widgets/controls",
11688 "_model_module_version": "1.5.0",
11689 "_model_name": "DescriptionStyleModel",
11690 "_view_count": null,
11691 "_view_module": "@jupyter-widgets/base",
11692 "_view_module_version": "1.2.0",
11693 "_view_name": "StyleView",
11694 "description_width": ""
11695 }
11696 },
11697 "ae8efd2c29bb4008a13be5b0483928b4": {
11698 "model_module": "@jupyter-widgets/base",
11699 "model_name": "LayoutModel",
11700 "model_module_version": "1.2.0",
11701 "state": {
11702 "_model_module": "@jupyter-widgets/base",
11703 "_model_module_version": "1.2.0",
11704 "_model_name": "LayoutModel",
11705 "_view_count": null,
11706 "_view_module": "@jupyter-widgets/base",
11707 "_view_module_version": "1.2.0",
11708 "_view_name": "LayoutView",
11709 "align_content": null,
11710 "align_items": null,
11711 "align_self": null,
11712 "border": null,
11713 "bottom": null,
11714 "display": null,
11715 "flex": "2",
11716 "flex_flow": null,
11717 "grid_area": null,
11718 "grid_auto_columns": null,
11719 "grid_auto_flow": null,
11720 "grid_auto_rows": null,
11721 "grid_column": null,
11722 "grid_gap": null,
11723 "grid_row": null,
11724 "grid_template_areas": null,
11725 "grid_template_columns": null,
11726 "grid_template_rows": null,
11727 "height": null,
11728 "justify_content": null,
11729 "justify_items": null,
11730 "left": null,
11731 "margin": null,
11732 "max_height": null,
11733 "max_width": null,
11734 "min_height": null,
11735 "min_width": null,
11736 "object_fit": null,
11737 "object_position": null,
11738 "order": null,
11739 "overflow": null,
11740 "overflow_x": null,
11741 "overflow_y": null,
11742 "padding": null,
11743 "right": null,
11744 "top": null,
11745 "visibility": null,
11746 "width": null
11747 }
11748 },
11749 "7728374b25ec4b45b3d9171e69173bf5": {
11750 "model_module": "@jupyter-widgets/controls",
11751 "model_name": "ProgressStyleModel",
11752 "model_module_version": "1.5.0",
11753 "state": {
11754 "_model_module": "@jupyter-widgets/controls",
11755 "_model_module_version": "1.5.0",
11756 "_model_name": "ProgressStyleModel",
11757 "_view_count": null,
11758 "_view_module": "@jupyter-widgets/base",
11759 "_view_module_version": "1.2.0",
11760 "_view_name": "StyleView",
11761 "bar_color": null,
11762 "description_width": ""
11763 }
11764 },
11765 "a7456e34baef4c89979963a8e61b98e4": {
11766 "model_module": "@jupyter-widgets/base",
11767 "model_name": "LayoutModel",
11768 "model_module_version": "1.2.0",
11769 "state": {
11770 "_model_module": "@jupyter-widgets/base",
11771 "_model_module_version": "1.2.0",
11772 "_model_name": "LayoutModel",
11773 "_view_count": null,
11774 "_view_module": "@jupyter-widgets/base",
11775 "_view_module_version": "1.2.0",
11776 "_view_name": "LayoutView",
11777 "align_content": null,
11778 "align_items": null,
11779 "align_self": null,
11780 "border": null,
11781 "bottom": null,
11782 "display": null,
11783 "flex": null,
11784 "flex_flow": null,
11785 "grid_area": null,
11786 "grid_auto_columns": null,
11787 "grid_auto_flow": null,
11788 "grid_auto_rows": null,
11789 "grid_column": null,
11790 "grid_gap": null,
11791 "grid_row": null,
11792 "grid_template_areas": null,
11793 "grid_template_columns": null,
11794 "grid_template_rows": null,
11795 "height": null,
11796 "justify_content": null,
11797 "justify_items": null,
11798 "left": null,
11799 "margin": null,
11800 "max_height": null,
11801 "max_width": null,
11802 "min_height": null,
11803 "min_width": null,
11804 "object_fit": null,
11805 "object_position": null,
11806 "order": null,
11807 "overflow": null,
11808 "overflow_x": null,
11809 "overflow_y": null,
11810 "padding": null,
11811 "right": null,
11812 "top": null,
11813 "visibility": null,
11814 "width": null
11815 }
11816 },
11817 "1db1f8a2985947639120d9bccdf3208e": {
11818 "model_module": "@jupyter-widgets/controls",
11819 "model_name": "DescriptionStyleModel",
11820 "model_module_version": "1.5.0",
11821 "state": {
11822 "_model_module": "@jupyter-widgets/controls",
11823 "_model_module_version": "1.5.0",
11824 "_model_name": "DescriptionStyleModel",
11825 "_view_count": null,
11826 "_view_module": "@jupyter-widgets/base",
11827 "_view_module_version": "1.2.0",
11828 "_view_name": "StyleView",
11829 "description_width": ""
11830 }
11831 },
11832 "ac7a77f2fd1b4cdaab3ae8ff2bb8b963": {
11833 "model_module": "@jupyter-widgets/controls",
11834 "model_name": "HBoxModel",
11835 "model_module_version": "1.5.0",
11836 "state": {
11837 "_dom_classes": [],
11838 "_model_module": "@jupyter-widgets/controls",
11839 "_model_module_version": "1.5.0",
11840 "_model_name": "HBoxModel",
11841 "_view_count": null,
11842 "_view_module": "@jupyter-widgets/controls",
11843 "_view_module_version": "1.5.0",
11844 "_view_name": "HBoxView",
11845 "box_style": "",
11846 "children": [
11847 "IPY_MODEL_2486dff82a4b41809b4a8ac2569b7e10",
11848 "IPY_MODEL_bcb064131d464033be2a95b5df8e2c82",
11849 "IPY_MODEL_4614b06d5a974ecf86238f938e58bccb"
11850 ],
11851 "layout": "IPY_MODEL_7d3a28c174ff4c2791039495b544b507"
11852 }
11853 },
11854 "2486dff82a4b41809b4a8ac2569b7e10": {
11855 "model_module": "@jupyter-widgets/controls",
11856 "model_name": "HTMLModel",
11857 "model_module_version": "1.5.0",
11858 "state": {
11859 "_dom_classes": [],
11860 "_model_module": "@jupyter-widgets/controls",
11861 "_model_module_version": "1.5.0",
11862 "_model_name": "HTMLModel",
11863 "_view_count": null,
11864 "_view_module": "@jupyter-widgets/controls",
11865 "_view_module_version": "1.5.0",
11866 "_view_name": "HTMLView",
11867 "description": "",
11868 "description_tooltip": null,
11869 "layout": "IPY_MODEL_58a114346ac44a8c992da25fb7c721f8",
11870 "placeholder": "​",
11871 "style": "IPY_MODEL_58e96bfc8f6a449eafa644edf4b75228",
11872 "value": "Validation DataLoader 0: 100%"
11873 }
11874 },
11875 "bcb064131d464033be2a95b5df8e2c82": {
11876 "model_module": "@jupyter-widgets/controls",
11877 "model_name": "FloatProgressModel",
11878 "model_module_version": "1.5.0",
11879 "state": {
11880 "_dom_classes": [],
11881 "_model_module": "@jupyter-widgets/controls",
11882 "_model_module_version": "1.5.0",
11883 "_model_name": "FloatProgressModel",
11884 "_view_count": null,
11885 "_view_module": "@jupyter-widgets/controls",
11886 "_view_module_version": "1.5.0",
11887 "_view_name": "ProgressView",
11888 "bar_style": "",
11889 "description": "",
11890 "description_tooltip": null,
11891 "layout": "IPY_MODEL_3bafea3ba4b347e186da01e279f41084",
11892 "max": 1,
11893 "min": 0,
11894 "orientation": "horizontal",
11895 "style": "IPY_MODEL_d8fa48e20376478e9e89438aa57de80d",
11896 "value": 1
11897 }
11898 },
11899 "4614b06d5a974ecf86238f938e58bccb": {
11900 "model_module": "@jupyter-widgets/controls",
11901 "model_name": "HTMLModel",
11902 "model_module_version": "1.5.0",
11903 "state": {
11904 "_dom_classes": [],
11905 "_model_module": "@jupyter-widgets/controls",
11906 "_model_module_version": "1.5.0",
11907 "_model_name": "HTMLModel",
11908 "_view_count": null,
11909 "_view_module": "@jupyter-widgets/controls",
11910 "_view_module_version": "1.5.0",
11911 "_view_name": "HTMLView",
11912 "description": "",
11913 "description_tooltip": null,
11914 "layout": "IPY_MODEL_5d9aaed3cf2e451595690e72ed4c2495",
11915 "placeholder": "​",
11916 "style": "IPY_MODEL_ab7aabf047e34d5899bc3dcfa972f7fd",
11917 "value": " 1/1 [00:00&lt;00:00, 69.60it/s]"
11918 }
11919 },
11920 "7d3a28c174ff4c2791039495b544b507": {
11921 "model_module": "@jupyter-widgets/base",
11922 "model_name": "LayoutModel",
11923 "model_module_version": "1.2.0",
11924 "state": {
11925 "_model_module": "@jupyter-widgets/base",
11926 "_model_module_version": "1.2.0",
11927 "_model_name": "LayoutModel",
11928 "_view_count": null,
11929 "_view_module": "@jupyter-widgets/base",
11930 "_view_module_version": "1.2.0",
11931 "_view_name": "LayoutView",
11932 "align_content": null,
11933 "align_items": null,
11934 "align_self": null,
11935 "border": null,
11936 "bottom": null,
11937 "display": "inline-flex",
11938 "flex": null,
11939 "flex_flow": "row wrap",
11940 "grid_area": null,
11941 "grid_auto_columns": null,
11942 "grid_auto_flow": null,
11943 "grid_auto_rows": null,
11944 "grid_column": null,
11945 "grid_gap": null,
11946 "grid_row": null,
11947 "grid_template_areas": null,
11948 "grid_template_columns": null,
11949 "grid_template_rows": null,
11950 "height": null,
11951 "justify_content": null,
11952 "justify_items": null,
11953 "left": null,
11954 "margin": null,
11955 "max_height": null,
11956 "max_width": null,
11957 "min_height": null,
11958 "min_width": null,
11959 "object_fit": null,
11960 "object_position": null,
11961 "order": null,
11962 "overflow": null,
11963 "overflow_x": null,
11964 "overflow_y": null,
11965 "padding": null,
11966 "right": null,
11967 "top": null,
11968 "visibility": null,
11969 "width": "100%"
11970 }
11971 },
11972 "58a114346ac44a8c992da25fb7c721f8": {
11973 "model_module": "@jupyter-widgets/base",
11974 "model_name": "LayoutModel",
11975 "model_module_version": "1.2.0",
11976 "state": {
11977 "_model_module": "@jupyter-widgets/base",
11978 "_model_module_version": "1.2.0",
11979 "_model_name": "LayoutModel",
11980 "_view_count": null,
11981 "_view_module": "@jupyter-widgets/base",
11982 "_view_module_version": "1.2.0",
11983 "_view_name": "LayoutView",
11984 "align_content": null,
11985 "align_items": null,
11986 "align_self": null,
11987 "border": null,
11988 "bottom": null,
11989 "display": null,
11990 "flex": null,
11991 "flex_flow": null,
11992 "grid_area": null,
11993 "grid_auto_columns": null,
11994 "grid_auto_flow": null,
11995 "grid_auto_rows": null,
11996 "grid_column": null,
11997 "grid_gap": null,
11998 "grid_row": null,
11999 "grid_template_areas": null,
12000 "grid_template_columns": null,
12001 "grid_template_rows": null,
12002 "height": null,
12003 "justify_content": null,
12004 "justify_items": null,
12005 "left": null,
12006 "margin": null,
12007 "max_height": null,
12008 "max_width": null,
12009 "min_height": null,
12010 "min_width": null,
12011 "object_fit": null,
12012 "object_position": null,
12013 "order": null,
12014 "overflow": null,
12015 "overflow_x": null,
12016 "overflow_y": null,
12017 "padding": null,
12018 "right": null,
12019 "top": null,
12020 "visibility": null,
12021 "width": null
12022 }
12023 },
12024 "58e96bfc8f6a449eafa644edf4b75228": {
12025 "model_module": "@jupyter-widgets/controls",
12026 "model_name": "DescriptionStyleModel",
12027 "model_module_version": "1.5.0",
12028 "state": {
12029 "_model_module": "@jupyter-widgets/controls",
12030 "_model_module_version": "1.5.0",
12031 "_model_name": "DescriptionStyleModel",
12032 "_view_count": null,
12033 "_view_module": "@jupyter-widgets/base",
12034 "_view_module_version": "1.2.0",
12035 "_view_name": "StyleView",
12036 "description_width": ""
12037 }
12038 },
12039 "3bafea3ba4b347e186da01e279f41084": {
12040 "model_module": "@jupyter-widgets/base",
12041 "model_name": "LayoutModel",
12042 "model_module_version": "1.2.0",
12043 "state": {
12044 "_model_module": "@jupyter-widgets/base",
12045 "_model_module_version": "1.2.0",
12046 "_model_name": "LayoutModel",
12047 "_view_count": null,
12048 "_view_module": "@jupyter-widgets/base",
12049 "_view_module_version": "1.2.0",
12050 "_view_name": "LayoutView",
12051 "align_content": null,
12052 "align_items": null,
12053 "align_self": null,
12054 "border": null,
12055 "bottom": null,
12056 "display": null,
12057 "flex": "2",
12058 "flex_flow": null,
12059 "grid_area": null,
12060 "grid_auto_columns": null,
12061 "grid_auto_flow": null,
12062 "grid_auto_rows": null,
12063 "grid_column": null,
12064 "grid_gap": null,
12065 "grid_row": null,
12066 "grid_template_areas": null,
12067 "grid_template_columns": null,
12068 "grid_template_rows": null,
12069 "height": null,
12070 "justify_content": null,
12071 "justify_items": null,
12072 "left": null,
12073 "margin": null,
12074 "max_height": null,
12075 "max_width": null,
12076 "min_height": null,
12077 "min_width": null,
12078 "object_fit": null,
12079 "object_position": null,
12080 "order": null,
12081 "overflow": null,
12082 "overflow_x": null,
12083 "overflow_y": null,
12084 "padding": null,
12085 "right": null,
12086 "top": null,
12087 "visibility": null,
12088 "width": null
12089 }
12090 },
12091 "d8fa48e20376478e9e89438aa57de80d": {
12092 "model_module": "@jupyter-widgets/controls",
12093 "model_name": "ProgressStyleModel",
12094 "model_module_version": "1.5.0",
12095 "state": {
12096 "_model_module": "@jupyter-widgets/controls",
12097 "_model_module_version": "1.5.0",
12098 "_model_name": "ProgressStyleModel",
12099 "_view_count": null,
12100 "_view_module": "@jupyter-widgets/base",
12101 "_view_module_version": "1.2.0",
12102 "_view_name": "StyleView",
12103 "bar_color": null,
12104 "description_width": ""
12105 }
12106 },
12107 "5d9aaed3cf2e451595690e72ed4c2495": {
12108 "model_module": "@jupyter-widgets/base",
12109 "model_name": "LayoutModel",
12110 "model_module_version": "1.2.0",
12111 "state": {
12112 "_model_module": "@jupyter-widgets/base",
12113 "_model_module_version": "1.2.0",
12114 "_model_name": "LayoutModel",
12115 "_view_count": null,
12116 "_view_module": "@jupyter-widgets/base",
12117 "_view_module_version": "1.2.0",
12118 "_view_name": "LayoutView",
12119 "align_content": null,
12120 "align_items": null,
12121 "align_self": null,
12122 "border": null,
12123 "bottom": null,
12124 "display": null,
12125 "flex": null,
12126 "flex_flow": null,
12127 "grid_area": null,
12128 "grid_auto_columns": null,
12129 "grid_auto_flow": null,
12130 "grid_auto_rows": null,
12131 "grid_column": null,
12132 "grid_gap": null,
12133 "grid_row": null,
12134 "grid_template_areas": null,
12135 "grid_template_columns": null,
12136 "grid_template_rows": null,
12137 "height": null,
12138 "justify_content": null,
12139 "justify_items": null,
12140 "left": null,
12141 "margin": null,
12142 "max_height": null,
12143 "max_width": null,
12144 "min_height": null,
12145 "min_width": null,
12146 "object_fit": null,
12147 "object_position": null,
12148 "order": null,
12149 "overflow": null,
12150 "overflow_x": null,
12151 "overflow_y": null,
12152 "padding": null,
12153 "right": null,
12154 "top": null,
12155 "visibility": null,
12156 "width": null
12157 }
12158 },
12159 "ab7aabf047e34d5899bc3dcfa972f7fd": {
12160 "model_module": "@jupyter-widgets/controls",
12161 "model_name": "DescriptionStyleModel",
12162 "model_module_version": "1.5.0",
12163 "state": {
12164 "_model_module": "@jupyter-widgets/controls",
12165 "_model_module_version": "1.5.0",
12166 "_model_name": "DescriptionStyleModel",
12167 "_view_count": null,
12168 "_view_module": "@jupyter-widgets/base",
12169 "_view_module_version": "1.2.0",
12170 "_view_name": "StyleView",
12171 "description_width": ""
12172 }
12173 },
12174 "8a006c7b0f0d431c8c024aad2ea8e427": {
12175 "model_module": "@jupyter-widgets/controls",
12176 "model_name": "HBoxModel",
12177 "model_module_version": "1.5.0",
12178 "state": {
12179 "_dom_classes": [],
12180 "_model_module": "@jupyter-widgets/controls",
12181 "_model_module_version": "1.5.0",
12182 "_model_name": "HBoxModel",
12183 "_view_count": null,
12184 "_view_module": "@jupyter-widgets/controls",
12185 "_view_module_version": "1.5.0",
12186 "_view_name": "HBoxView",
12187 "box_style": "",
12188 "children": [
12189 "IPY_MODEL_cc122dc799da42948360712d0b809ed9",
12190 "IPY_MODEL_d3186548246149feaa9228782d7adaab",
12191 "IPY_MODEL_96660986fcd1451d8565790e961277b5"
12192 ],
12193 "layout": "IPY_MODEL_e6d820247bfc42acbff367b5794b6655"
12194 }
12195 },
12196 "cc122dc799da42948360712d0b809ed9": {
12197 "model_module": "@jupyter-widgets/controls",
12198 "model_name": "HTMLModel",
12199 "model_module_version": "1.5.0",
12200 "state": {
12201 "_dom_classes": [],
12202 "_model_module": "@jupyter-widgets/controls",
12203 "_model_module_version": "1.5.0",
12204 "_model_name": "HTMLModel",
12205 "_view_count": null,
12206 "_view_module": "@jupyter-widgets/controls",
12207 "_view_module_version": "1.5.0",
12208 "_view_name": "HTMLView",
12209 "description": "",
12210 "description_tooltip": null,
12211 "layout": "IPY_MODEL_b7ff8b76997a4235a3205fac9c531502",
12212 "placeholder": "​",
12213 "style": "IPY_MODEL_00e7a13db6174f3182a898345dd1d38d",
12214 "value": "Validation DataLoader 0: 100%"
12215 }
12216 },
12217 "d3186548246149feaa9228782d7adaab": {
12218 "model_module": "@jupyter-widgets/controls",
12219 "model_name": "FloatProgressModel",
12220 "model_module_version": "1.5.0",
12221 "state": {
12222 "_dom_classes": [],
12223 "_model_module": "@jupyter-widgets/controls",
12224 "_model_module_version": "1.5.0",
12225 "_model_name": "FloatProgressModel",
12226 "_view_count": null,
12227 "_view_module": "@jupyter-widgets/controls",
12228 "_view_module_version": "1.5.0",
12229 "_view_name": "ProgressView",
12230 "bar_style": "",
12231 "descriptio