WEBVTT Kind: captions Language: en 00:00:00.000 --> 00:00:04.350 align:start position:0% foreign 00:00:04.350 --> 00:00:04.360 align:start position:0% 00:00:04.360 --> 00:00:17.050 align:start position:0% [Music] 00:00:17.050 --> 00:00:17.060 align:start position:0% 00:00:17.060 --> 00:00:20.870 align:start position:0% good<00:00:18.060> morning<00:00:18.180> everyone<00:00:18.539> how<00:00:19.140> are<00:00:19.260> you 00:00:20.870 --> 00:00:20.880 align:start position:0% good morning everyone how are you 00:00:20.880 --> 00:00:22.250 align:start position:0% good morning everyone how are you so 00:00:22.250 --> 00:00:22.260 align:start position:0% so 00:00:22.260 --> 00:00:25.429 align:start position:0% so let's<00:00:22.800> start<00:00:23.039> I'm<00:00:23.580> Tom<00:00:23.820> I<00:00:24.359> work<00:00:24.539> for<00:00:24.720> simiotic 00:00:25.429 --> 00:00:25.439 align:start position:0% let's start I'm Tom I work for simiotic 00:00:25.439 --> 00:00:27.589 align:start position:0% let's start I'm Tom I work for simiotic labs<00:00:25.800> and<00:00:26.400> today<00:00:26.580> I'll<00:00:26.760> have<00:00:27.000> the<00:00:27.180> pleasure<00:00:27.480> to 00:00:27.589 --> 00:00:27.599 align:start position:0% labs and today I'll have the pleasure to 00:00:27.599 --> 00:00:30.230 align:start position:0% labs and today I'll have the pleasure to present<00:00:27.900> you<00:00:28.080> our<00:00:28.560> work<00:00:28.859> on<00:00:29.640> reinforcement 00:00:30.230 --> 00:00:30.240 align:start position:0% present you our work on reinforcement 00:00:30.240 --> 00:00:32.870 align:start position:0% present you our work on reinforcement learning<00:00:30.660> in<00:00:31.019> color<00:00:31.800> pricing<00:00:32.279> in<00:00:32.520> the<00:00:32.700> graph 00:00:32.870 --> 00:00:32.880 align:start position:0% learning in color pricing in the graph 00:00:32.880 --> 00:00:37.010 align:start position:0% learning in color pricing in the graph so<00:00:34.260> first<00:00:35.040> let<00:00:35.640> me<00:00:35.760> start<00:00:35.940> with<00:00:36.120> the<00:00:36.300> outline<00:00:36.660> I 00:00:37.010 --> 00:00:37.020 align:start position:0% so first let me start with the outline I 00:00:37.020 --> 00:00:38.450 align:start position:0% so first let me start with the outline I will<00:00:37.200> tell<00:00:37.320> a<00:00:37.440> few<00:00:37.559> words<00:00:37.680> about<00:00:37.920> semiatric 00:00:38.450 --> 00:00:38.460 align:start position:0% will tell a few words about semiatric 00:00:38.460 --> 00:00:40.670 align:start position:0% will tell a few words about semiatric what<00:00:38.579> we<00:00:38.700> are<00:00:38.820> doing<00:00:38.940> then<00:00:39.660> I'll<00:00:39.960> introduce 00:00:40.670 --> 00:00:40.680 align:start position:0% what we are doing then I'll introduce 00:00:40.680 --> 00:00:42.830 align:start position:0% what we are doing then I'll introduce what<00:00:41.340> what's<00:00:41.640> really<00:00:41.820> we<00:00:42.180> are<00:00:42.300> doing<00:00:42.480> in<00:00:42.660> this 00:00:42.830 --> 00:00:42.840 align:start position:0% what what's really we are doing in this 00:00:42.840 --> 00:00:45.650 align:start position:0% what what's really we are doing in this area<00:00:42.960> automated<00:00:43.620> price<00:00:44.160> Discovery<00:00:44.760> I<00:00:45.480> will 00:00:45.650 --> 00:00:45.660 align:start position:0% area automated price Discovery I will 00:00:45.660 --> 00:00:47.690 align:start position:0% area automated price Discovery I will formulate<00:00:46.020> the<00:00:46.140> problem<00:00:46.320> I<00:00:46.980> will 00:00:47.690 --> 00:00:47.700 align:start position:0% formulate the problem I will 00:00:47.700 --> 00:00:49.310 align:start position:0% formulate the problem I will add<00:00:48.180> a<00:00:48.300> few<00:00:48.360> words<00:00:48.539> up<00:00:48.719> when<00:00:48.899> it<00:00:49.079> comes<00:00:49.200> to 00:00:49.310 --> 00:00:49.320 align:start position:0% add a few words up when it comes to 00:00:49.320 --> 00:00:51.709 align:start position:0% add a few words up when it comes to modeling<00:00:49.800> how<00:00:50.039> we<00:00:50.219> model<00:00:50.399> that<00:00:50.700> problem<00:00:50.940> then 00:00:51.709 --> 00:00:51.719 align:start position:0% modeling how we model that problem then 00:00:51.719 --> 00:00:53.690 align:start position:0% modeling how we model that problem then I'll<00:00:52.020> briefly<00:00:52.500> went<00:00:52.680> through<00:00:52.920> reinforcement 00:00:53.690 --> 00:00:53.700 align:start position:0% I'll briefly went through reinforcement 00:00:53.700 --> 00:00:56.209 align:start position:0% I'll briefly went through reinforcement learning<00:00:54.180> Basics<00:00:54.899> let's<00:00:55.260> say<00:00:55.440> it's<00:00:55.860> just<00:00:56.039> a 00:00:56.209 --> 00:00:56.219 align:start position:0% learning Basics let's say it's just a 00:00:56.219 --> 00:00:58.850 align:start position:0% learning Basics let's say it's just a refresher<00:00:56.760> for<00:00:57.480> those<00:00:57.719> ones<00:00:58.140> of<00:00:58.320> you<00:00:58.500> who<00:00:58.680> know 00:00:58.850 --> 00:00:58.860 align:start position:0% refresher for those ones of you who know 00:00:58.860 --> 00:01:00.650 align:start position:0% refresher for those ones of you who know or<00:00:59.160> maybe<00:00:59.340> do<00:00:59.640> not<00:00:59.760> know<00:00:59.940> enforcement 00:01:00.650 --> 00:01:00.660 align:start position:0% or maybe do not know enforcement 00:01:00.660 --> 00:01:03.349 align:start position:0% or maybe do not know enforcement learning<00:01:01.559> then<00:01:02.100> agent-based<00:01:02.820> modeling<00:01:03.120> is 00:01:03.349 --> 00:01:03.359 align:start position:0% learning then agent-based modeling is 00:01:03.359 --> 00:01:05.750 align:start position:0% learning then agent-based modeling is the<00:01:03.539> the<00:01:03.840> core<00:01:04.260> of<00:01:04.559> the<00:01:04.680> talk<00:01:04.920> and<00:01:05.280> I<00:01:05.460> will<00:01:05.580> show 00:01:05.750 --> 00:01:05.760 align:start position:0% the the core of the talk and I will show 00:01:05.760 --> 00:01:07.250 align:start position:0% the the core of the talk and I will show how<00:01:06.060> we're<00:01:06.180> using<00:01:06.479> that<00:01:06.540> for<00:01:06.720> testing<00:01:07.140> system 00:01:07.250 --> 00:01:07.260 align:start position:0% how we're using that for testing system 00:01:07.260 --> 00:01:10.850 align:start position:0% how we're using that for testing system properties<00:01:07.860> then<00:01:08.159> and<00:01:08.760> for<00:01:08.939> testing<00:01:09.860> well 00:01:10.850 --> 00:01:10.860 align:start position:0% properties then and for testing well 00:01:10.860 --> 00:01:12.950 align:start position:0% properties then and for testing well different<00:01:11.100> behaviors<00:01:11.700> when<00:01:12.600> it<00:01:12.720> comes<00:01:12.840> to 00:01:12.950 --> 00:01:12.960 align:start position:0% different behaviors when it comes to 00:01:12.960 --> 00:01:15.410 align:start position:0% different behaviors when it comes to using<00:01:13.200> single<00:01:13.619> and<00:01:13.680> multi-agent<00:01:14.460> setups 00:01:15.410 --> 00:01:15.420 align:start position:0% using single and multi-agent setups 00:01:15.420 --> 00:01:18.050 align:start position:0% using single and multi-agent setups and<00:01:15.960> then<00:01:16.140> I<00:01:16.320> will<00:01:16.500> show<00:01:16.799> that<00:01:17.400> actually<00:01:17.640> we 00:01:18.050 --> 00:01:18.060 align:start position:0% and then I will show that actually we 00:01:18.060 --> 00:01:20.090 align:start position:0% and then I will show that actually we deploy<00:01:18.420> that<00:01:18.659> that<00:01:19.320> solution<00:01:19.680> in<00:01:19.799> production 00:01:20.090 --> 00:01:20.100 align:start position:0% deploy that that solution in production 00:01:20.100 --> 00:01:22.609 align:start position:0% deploy that that solution in production what<00:01:20.460> are<00:01:20.580> the<00:01:20.700> results<00:01:20.880> and<00:01:21.840> finish<00:01:22.080> with<00:01:22.439> a 00:01:22.609 --> 00:01:22.619 align:start position:0% what are the results and finish with a 00:01:22.619 --> 00:01:25.910 align:start position:0% what are the results and finish with a small<00:01:22.860> summary<00:01:23.280> all<00:01:24.119> right<00:01:24.299> so<00:01:25.200> let's<00:01:25.680> start 00:01:25.910 --> 00:01:25.920 align:start position:0% small summary all right so let's start 00:01:25.920 --> 00:01:28.130 align:start position:0% small summary all right so let's start the<00:01:26.520> first<00:01:26.700> semiotic<00:01:27.240> symmetric<00:01:27.720> Labs<00:01:28.020> was 00:01:28.130 --> 00:01:28.140 align:start position:0% the first semiotic symmetric Labs was 00:01:28.140 --> 00:01:31.490 align:start position:0% the first semiotic symmetric Labs was founded<00:01:28.380> in<00:01:28.500> 2020<00:01:29.060> by<00:01:30.060> Ai<00:01:30.720> and<00:01:30.840> cryptography 00:01:31.490 --> 00:01:31.500 align:start position:0% founded in 2020 by Ai and cryptography 00:01:31.500 --> 00:01:34.550 align:start position:0% founded in 2020 by Ai and cryptography researchers<00:01:32.060> uh<00:01:33.060> we<00:01:33.600> are<00:01:33.900> focusing<00:01:34.320> on 00:01:34.550 --> 00:01:34.560 align:start position:0% researchers uh we are focusing on 00:01:34.560 --> 00:01:37.249 align:start position:0% researchers uh we are focusing on applied<00:01:35.460> research<00:01:35.939> and<00:01:36.600> we<00:01:36.780> are<00:01:36.900> one<00:01:37.079> of<00:01:37.200> the 00:01:37.249 --> 00:01:37.259 align:start position:0% applied research and we are one of the 00:01:37.259 --> 00:01:39.670 align:start position:0% applied research and we are one of the core<00:01:37.439> depths<00:01:37.860> of<00:01:38.040> the<00:01:38.340> of<00:01:38.759> the<00:01:38.939> graph<00:01:39.180> protocol 00:01:39.670 --> 00:01:39.680 align:start position:0% core depths of the of the graph protocol 00:01:39.680 --> 00:01:42.230 align:start position:0% core depths of the of the graph protocol also<00:01:40.680> we<00:01:40.860> are<00:01:40.979> developers<00:01:41.400> of<00:01:41.579> others<00:01:42.119> the 00:01:42.230 --> 00:01:42.240 align:start position:0% also we are developers of others the 00:01:42.240 --> 00:01:45.950 align:start position:0% also we are developers of others the optimal<00:01:42.600> text<00:01:42.840> aggregator<00:01:43.520> uh<00:01:44.520> actually<00:01:44.960> the 00:01:45.950 --> 00:01:45.960 align:start position:0% optimal text aggregator uh actually the 00:01:45.960 --> 00:01:49.130 align:start position:0% optimal text aggregator uh actually the the<00:01:46.700> lead<00:01:47.700> of<00:01:47.939> that<00:01:48.180> product<00:01:48.360> is<00:01:48.659> giving<00:01:48.900> a 00:01:49.130 --> 00:01:49.140 align:start position:0% the lead of that product is giving a 00:01:49.140 --> 00:01:50.749 align:start position:0% the lead of that product is giving a talk<00:01:49.320> at<00:01:49.619> the<00:01:49.680> very<00:01:49.799> moment<00:01:50.100> on<00:01:50.460> a<00:01:50.579> different 00:01:50.749 --> 00:01:50.759 align:start position:0% talk at the very moment on a different 00:01:50.759 --> 00:01:52.670 align:start position:0% talk at the very moment on a different stage<00:01:51.119> so 00:01:52.670 --> 00:01:52.680 align:start position:0% stage so 00:01:52.680 --> 00:01:57.050 align:start position:0% stage so bad<00:01:53.280> luck<00:01:53.840> okay<00:01:54.840> so<00:01:55.140> our<00:01:55.259> expertise<00:01:55.740> we 00:01:57.050 --> 00:01:57.060 align:start position:0% bad luck okay so our expertise we 00:01:57.060 --> 00:01:59.510 align:start position:0% bad luck okay so our expertise we we<00:01:57.899> combine<00:01:58.259> the<00:01:58.380> cryptography<00:01:58.979> with<00:01:59.159> AI 00:01:59.510 --> 00:01:59.520 align:start position:0% we combine the cryptography with AI 00:01:59.520 --> 00:02:01.190 align:start position:0% we combine the cryptography with AI That's<00:01:59.820> our<00:02:00.060> core<00:02:00.299> expertise<00:02:00.840> and<00:02:00.960> of<00:02:01.140> course 00:02:01.190 --> 00:02:01.200 align:start position:0% That's our core expertise and of course 00:02:01.200 --> 00:02:02.569 align:start position:0% That's our core expertise and of course there<00:02:01.380> are<00:02:01.500> software<00:02:01.740> engineering<00:02:02.220> involved 00:02:02.569 --> 00:02:02.579 align:start position:0% there are software engineering involved 00:02:02.579 --> 00:02:04.130 align:start position:0% there are software engineering involved and<00:02:03.060> we<00:02:03.180> focus<00:02:03.420> mostly<00:02:03.840> on<00:02:03.960> building 00:02:04.130 --> 00:02:04.140 align:start position:0% and we focus mostly on building 00:02:04.140 --> 00:02:06.350 align:start position:0% and we focus mostly on building infrastructure<00:02:04.860> we<00:02:05.520> focus<00:02:05.820> on<00:02:06.000> crypto 00:02:06.350 --> 00:02:06.360 align:start position:0% infrastructure we focus on crypto 00:02:06.360 --> 00:02:07.870 align:start position:0% infrastructure we focus on crypto economics<00:02:06.840> today's<00:02:07.140> talks<00:02:07.680> actually 00:02:07.870 --> 00:02:07.880 align:start position:0% economics today's talks actually 00:02:07.880 --> 00:02:11.390 align:start position:0% economics today's talks actually focusing<00:02:08.880> on<00:02:09.000> this<00:02:09.179> on<00:02:09.360> crypto<00:02:09.660> economics<00:02:10.400> all 00:02:11.390 --> 00:02:11.400 align:start position:0% focusing on this on crypto economics all 00:02:11.400 --> 00:02:13.790 align:start position:0% focusing on this on crypto economics all right<00:02:11.520> so 00:02:13.790 --> 00:02:13.800 align:start position:0% right so 00:02:13.800 --> 00:02:16.130 align:start position:0% right so what<00:02:14.340> was<00:02:14.580> the<00:02:14.760> scenario<00:02:15.120> so<00:02:15.540> the<00:02:15.660> scenario<00:02:16.080> in 00:02:16.130 --> 00:02:16.140 align:start position:0% what was the scenario so the scenario in 00:02:16.140 --> 00:02:17.210 align:start position:0% what was the scenario so the scenario in here<00:02:16.319> is<00:02:16.500> that 00:02:17.210 --> 00:02:17.220 align:start position:0% here is that 00:02:17.220 --> 00:02:19.550 align:start position:0% here is that I<00:02:17.640> don't<00:02:17.760> know<00:02:17.819> which<00:02:18.420> one<00:02:18.599> of<00:02:18.780> you<00:02:18.900> know<00:02:19.260> the 00:02:19.550 --> 00:02:19.560 align:start position:0% I don't know which one of you know the 00:02:19.560 --> 00:02:20.990 align:start position:0% I don't know which one of you know the graph<00:02:19.800> actually<00:02:20.040> who<00:02:20.520> knows<00:02:20.700> the<00:02:20.819> graph 00:02:20.990 --> 00:02:21.000 align:start position:0% graph actually who knows the graph 00:02:21.000 --> 00:02:22.910 align:start position:0% graph actually who knows the graph protocol<00:02:21.360> all<00:02:22.080> right 00:02:22.910 --> 00:02:22.920 align:start position:0% protocol all right 00:02:22.920 --> 00:02:28.309 align:start position:0% protocol all right okay<00:02:23.520> 50<00:02:24.120> 50.<00:02:24.720> good<00:02:24.959> so<00:02:26.400> basically<00:02:27.239> in<00:02:28.140> this 00:02:28.309 --> 00:02:28.319 align:start position:0% okay 50 50. good so basically in this 00:02:28.319 --> 00:02:30.949 align:start position:0% okay 50 50. good so basically in this scenario<00:02:28.739> we<00:02:29.160> just<00:02:29.340> focus<00:02:29.580> on<00:02:29.760> on<00:02:30.000> on<00:02:30.180> one<00:02:30.780> part 00:02:30.949 --> 00:02:30.959 align:start position:0% scenario we just focus on on on one part 00:02:30.959 --> 00:02:32.750 align:start position:0% scenario we just focus on on on one part of<00:02:31.140> the<00:02:31.260> graph<00:02:31.500> system<00:02:31.920> right<00:02:32.220> of<00:02:32.459> the<00:02:32.580> graph 00:02:32.750 --> 00:02:32.760 align:start position:0% of the graph system right of the graph 00:02:32.760 --> 00:02:34.790 align:start position:0% of the graph system right of the graph protocol<00:02:33.180> but<00:02:33.959> imagine<00:02:34.140> that<00:02:34.500> you've<00:02:34.680> got 00:02:34.790 --> 00:02:34.800 align:start position:0% protocol but imagine that you've got 00:02:34.800 --> 00:02:36.530 align:start position:0% protocol but imagine that you've got some<00:02:34.980> customers<00:02:35.400> that<00:02:35.640> are<00:02:35.819> sending<00:02:36.239> queries 00:02:36.530 --> 00:02:36.540 align:start position:0% some customers that are sending queries 00:02:36.540 --> 00:02:38.510 align:start position:0% some customers that are sending queries right<00:02:37.020> and<00:02:37.260> you've<00:02:37.379> got<00:02:37.500> indexers<00:02:38.040> that<00:02:38.340> are 00:02:38.510 --> 00:02:38.520 align:start position:0% right and you've got indexers that are 00:02:38.520 --> 00:02:41.449 align:start position:0% right and you've got indexers that are indexing<00:02:39.120> blockchain<00:02:39.720> and<00:02:40.440> our<00:02:40.739> mechanical 00:02:41.449 --> 00:02:41.459 align:start position:0% indexing blockchain and our mechanical 00:02:41.459 --> 00:02:44.750 align:start position:0% indexing blockchain and our mechanical serving<00:02:42.120> serving<00:02:42.599> those<00:02:42.780> queries<00:02:43.200> so<00:02:43.980> between 00:02:44.750 --> 00:02:44.760 align:start position:0% serving serving those queries so between 00:02:44.760 --> 00:02:47.630 align:start position:0% serving serving those queries so between those<00:02:45.120> guys<00:02:45.440> there<00:02:46.440> is<00:02:46.620> an<00:02:46.920> entity<00:02:47.220> called<00:02:47.459> the 00:02:47.630 --> 00:02:47.640 align:start position:0% those guys there is an entity called the 00:02:47.640 --> 00:02:51.110 align:start position:0% those guys there is an entity called the gateway<00:02:48.000> which<00:02:48.840> is<00:02:49.019> doing<00:02:49.760> we're<00:02:50.760> just<00:02:50.940> gonna 00:02:51.110 --> 00:02:51.120 align:start position:0% gateway which is doing we're just gonna 00:02:51.120 --> 00:02:53.930 align:start position:0% gateway which is doing we're just gonna go<00:02:51.540> acting<00:02:52.500> as<00:02:52.620> a<00:02:52.860> query<00:02:53.040> market<00:02:53.280> right<00:02:53.700> so 00:02:53.930 --> 00:02:53.940 align:start position:0% go acting as a query market right so 00:02:53.940 --> 00:02:55.250 align:start position:0% go acting as a query market right so depending<00:02:54.360> on<00:02:54.480> the<00:02:54.660> price<00:02:54.780> the<00:02:55.080> price 00:02:55.250 --> 00:02:55.260 align:start position:0% depending on the price the price 00:02:55.260 --> 00:02:57.110 align:start position:0% depending on the price the price depending<00:02:55.620> on<00:02:55.800> the<00:02:55.860> quality<00:02:56.220> of<00:02:56.340> service<00:02:56.580> a 00:02:57.110 --> 00:02:57.120 align:start position:0% depending on the quality of service a 00:02:57.120 --> 00:02:59.150 align:start position:0% depending on the quality of service a given<00:02:57.420> query<00:02:57.720> sent<00:02:57.959> by<00:02:58.140> the<00:02:58.260> customers<00:02:58.680> when 00:02:59.150 --> 00:02:59.160 align:start position:0% given query sent by the customers when 00:02:59.160 --> 00:03:01.610 align:start position:0% given query sent by the customers when we<00:02:59.340> would<00:02:59.640> be<00:02:59.940> distributed<00:03:00.660> on<00:03:00.900> this<00:03:01.200> or<00:03:01.440> or 00:03:01.610 --> 00:03:01.620 align:start position:0% we would be distributed on this or or 00:03:01.620 --> 00:03:04.850 align:start position:0% we would be distributed on this or or that<00:03:02.040> indexer<00:03:02.580> and<00:03:03.300> indexers<00:03:03.959> earn<00:03:04.500> money<00:03:04.620> by 00:03:04.850 --> 00:03:04.860 align:start position:0% that indexer and indexers earn money by 00:03:04.860 --> 00:03:07.190 align:start position:0% that indexer and indexers earn money by serving<00:03:05.400> course<00:03:05.580> right<00:03:06.000> so<00:03:06.599> they<00:03:06.900> can<00:03:07.019> control 00:03:07.190 --> 00:03:07.200 align:start position:0% serving course right so they can control 00:03:07.200 --> 00:03:09.770 align:start position:0% serving course right so they can control the<00:03:07.560> prices<00:03:07.739> of<00:03:08.220> the<00:03:08.340> service<00:03:08.519> queries<00:03:09.060> and 00:03:09.770 --> 00:03:09.780 align:start position:0% the prices of the service queries and 00:03:09.780 --> 00:03:12.170 align:start position:0% the prices of the service queries and the<00:03:09.959> core<00:03:10.140> idea<00:03:10.620> that<00:03:11.400> that<00:03:11.640> I'm<00:03:11.879> going<00:03:12.060> to 00:03:12.170 --> 00:03:12.180 align:start position:0% the core idea that that I'm going to 00:03:12.180 --> 00:03:14.690 align:start position:0% the core idea that that I'm going to talk<00:03:12.360> about<00:03:12.540> in<00:03:13.440> today's<00:03:13.739> basically<00:03:14.400> wanted 00:03:14.690 --> 00:03:14.700 align:start position:0% talk about in today's basically wanted 00:03:14.700 --> 00:03:16.790 align:start position:0% talk about in today's basically wanted to<00:03:14.819> have<00:03:15.060> Dynamic<00:03:15.599> pricing<00:03:16.080> based<00:03:16.379> on<00:03:16.440> query 00:03:16.790 --> 00:03:16.800 align:start position:0% to have Dynamic pricing based on query 00:03:16.800 --> 00:03:19.369 align:start position:0% to have Dynamic pricing based on query volume<00:03:16.980> received<00:03:17.819> by<00:03:18.360> an<00:03:18.540> indexer<00:03:19.019> and<00:03:19.260> we 00:03:19.369 --> 00:03:19.379 align:start position:0% volume received by an indexer and we 00:03:19.379 --> 00:03:21.589 align:start position:0% volume received by an indexer and we call<00:03:19.500> that<00:03:19.739> auto<00:03:20.280> Agra<00:03:20.819> and<00:03:21.060> then<00:03:21.239> I<00:03:21.420> will 00:03:21.589 --> 00:03:21.599 align:start position:0% call that auto Agra and then I will 00:03:21.599 --> 00:03:23.390 align:start position:0% call that auto Agra and then I will explain<00:03:21.720> the<00:03:22.080> second<00:03:22.200> why<00:03:22.500> we<00:03:23.040> are<00:03:23.159> calling 00:03:23.390 --> 00:03:23.400 align:start position:0% explain the second why we are calling 00:03:23.400 --> 00:03:25.610 align:start position:0% explain the second why we are calling that<00:03:23.519> Auto<00:03:23.700> augura 00:03:25.610 --> 00:03:25.620 align:start position:0% that Auto augura 00:03:25.620 --> 00:03:29.509 align:start position:0% that Auto augura so<00:03:26.400> this<00:03:27.000> is<00:03:27.060> how<00:03:27.239> we<00:03:27.420> model<00:03:27.659> the<00:03:28.560> the<00:03:28.800> scenario 00:03:29.509 --> 00:03:29.519 align:start position:0% so this is how we model the the scenario 00:03:29.519 --> 00:03:32.030 align:start position:0% so this is how we model the the scenario right<00:03:30.239> it's<00:03:30.659> it's<00:03:31.019> simplified<00:03:31.500> from<00:03:31.860> one 00:03:32.030 --> 00:03:32.040 align:start position:0% right it's it's simplified from one 00:03:32.040 --> 00:03:34.309 align:start position:0% right it's it's simplified from one point<00:03:32.159> of<00:03:32.340> view<00:03:32.459> because<00:03:32.700> as<00:03:33.060> you<00:03:33.239> can<00:03:33.360> see<00:03:33.540> ah 00:03:34.309 --> 00:03:34.319 align:start position:0% point of view because as you can see ah 00:03:34.319 --> 00:03:37.430 align:start position:0% point of view because as you can see ah as<00:03:34.620> you<00:03:34.739> can<00:03:34.800> see<00:03:34.920> there<00:03:35.159> are<00:03:35.280> no<00:03:35.819> no<00:03:36.260> let's<00:03:37.260> say 00:03:37.430 --> 00:03:37.440 align:start position:0% as you can see there are no no let's say 00:03:37.440 --> 00:03:39.410 align:start position:0% as you can see there are no no let's say agents<00:03:37.980> in<00:03:38.099> here<00:03:38.280> we<00:03:38.819> get<00:03:38.940> rid<00:03:39.120> of<00:03:39.300> the 00:03:39.410 --> 00:03:39.420 align:start position:0% agents in here we get rid of the 00:03:39.420 --> 00:03:40.910 align:start position:0% agents in here we get rid of the customers<00:03:39.780> for<00:03:40.080> the<00:03:40.200> purpose<00:03:40.440> of<00:03:40.620> that 00:03:40.910 --> 00:03:40.920 align:start position:0% customers for the purpose of that 00:03:40.920 --> 00:03:43.250 align:start position:0% customers for the purpose of that flooding<00:03:41.340> of<00:03:41.519> those<00:03:42.180> simulations<00:03:42.599> instead 00:03:43.250 --> 00:03:43.260 align:start position:0% flooding of those simulations instead 00:03:43.260 --> 00:03:44.630 align:start position:0% flooding of those simulations instead we've<00:03:43.440> got<00:03:43.560> a<00:03:43.739> traffic<00:03:43.860> generator<00:03:44.340> right 00:03:44.630 --> 00:03:44.640 align:start position:0% we've got a traffic generator right 00:03:44.640 --> 00:03:46.729 align:start position:0% we've got a traffic generator right something<00:03:44.879> that<00:03:45.239> just<00:03:45.420> says<00:03:45.840> okay<00:03:46.019> at<00:03:46.379> given 00:03:46.729 --> 00:03:46.739 align:start position:0% something that just says okay at given 00:03:46.739 --> 00:03:48.289 align:start position:0% something that just says okay at given timestamp<00:03:47.159> this<00:03:47.400> is<00:03:47.459> the<00:03:47.580> query<00:03:47.819> volume<00:03:48.000> that 00:03:48.289 --> 00:03:48.299 align:start position:0% timestamp this is the query volume that 00:03:48.299 --> 00:03:50.750 align:start position:0% timestamp this is the query volume that you've<00:03:48.480> that<00:03:48.720> needs<00:03:49.019> to<00:03:49.080> be<00:03:49.200> served<00:03:49.560> right<00:03:50.220> we 00:03:50.750 --> 00:03:50.760 align:start position:0% you've that needs to be served right we 00:03:50.760 --> 00:03:53.630 align:start position:0% you've that needs to be served right we also<00:03:51.000> got<00:03:51.239> query<00:03:52.140> distributor<00:03:52.799> so<00:03:53.340> something 00:03:53.630 --> 00:03:53.640 align:start position:0% also got query distributor so something 00:03:53.640 --> 00:03:55.910 align:start position:0% also got query distributor so something that<00:03:54.120> basically<00:03:54.659> look<00:03:54.840> at<00:03:55.019> at<00:03:55.260> the<00:03:55.440> bits<00:03:55.739> of 00:03:55.910 --> 00:03:55.920 align:start position:0% that basically look at at the bits of 00:03:55.920 --> 00:03:58.130 align:start position:0% that basically look at at the bits of the<00:03:56.340> agents<00:03:56.700> so<00:03:56.879> the<00:03:57.000> agents<00:03:57.420> are<00:03:57.480> putting 00:03:58.130 --> 00:03:58.140 align:start position:0% the agents so the agents are putting 00:03:58.140 --> 00:04:00.830 align:start position:0% the agents so the agents are putting their<00:03:58.260> bids<00:03:59.060> and<00:04:00.060> then<00:04:00.180> depending<00:04:00.540> on<00:04:00.720> those 00:04:00.830 --> 00:04:00.840 align:start position:0% their bids and then depending on those 00:04:00.840 --> 00:04:02.630 align:start position:0% their bids and then depending on those bits<00:04:01.260> the<00:04:01.620> queries<00:04:01.980> will<00:04:02.159> be<00:04:02.280> distributed 00:04:02.630 --> 00:04:02.640 align:start position:0% bits the queries will be distributed 00:04:02.640 --> 00:04:05.270 align:start position:0% bits the queries will be distributed across<00:04:03.360> those<00:04:03.599> different<00:04:03.840> agents<00:04:04.440> and<00:04:05.099> those 00:04:05.270 --> 00:04:05.280 align:start position:0% across those different agents and those 00:04:05.280 --> 00:04:07.729 align:start position:0% across those different agents and those bits<00:04:05.640> are<00:04:05.819> expressed<00:04:06.180> in<00:04:06.299> a<00:04:06.480> domain<00:04:06.900> specific 00:04:07.729 --> 00:04:07.739 align:start position:0% bits are expressed in a domain specific 00:04:07.739 --> 00:04:10.070 align:start position:0% bits are expressed in a domain specific language<00:04:07.980> called<00:04:08.280> Agora<00:04:08.819> that's<00:04:09.060> why<00:04:09.299> the<00:04:09.840> I 00:04:10.070 --> 00:04:10.080 align:start position:0% language called Agora that's why the I 00:04:10.080 --> 00:04:12.649 align:start position:0% language called Agora that's why the I the<00:04:10.439> the<00:04:10.560> the<00:04:10.739> product<00:04:11.280> we<00:04:11.640> call<00:04:11.760> it<00:04:11.939> altag<00:04:12.360> all 00:04:12.649 --> 00:04:12.659 align:start position:0% the the the product we call it altag all 00:04:12.659 --> 00:04:14.089 align:start position:0% the the the product we call it altag all right<00:04:12.720> because<00:04:13.019> it<00:04:13.260> automates<00:04:13.680> that<00:04:13.920> that 00:04:14.089 --> 00:04:14.099 align:start position:0% right because it automates that that 00:04:14.099 --> 00:04:16.670 align:start position:0% right because it automates that that building<00:04:14.420> otherwise<00:04:15.420> the<00:04:15.900> users<00:04:16.320> will<00:04:16.500> have 00:04:16.670 --> 00:04:16.680 align:start position:0% building otherwise the users will have 00:04:16.680 --> 00:04:18.409 align:start position:0% building otherwise the users will have to<00:04:16.799> the<00:04:17.100> index<00:04:17.340> cells<00:04:17.639> have<00:04:17.760> to<00:04:17.880> basically 00:04:18.409 --> 00:04:18.419 align:start position:0% to the index cells have to basically 00:04:18.419 --> 00:04:21.469 align:start position:0% to the index cells have to basically create<00:04:18.660> those<00:04:19.019> those<00:04:19.620> price<00:04:20.519> models<00:04:21.060> manually 00:04:21.469 --> 00:04:21.479 align:start position:0% create those those price models manually 00:04:21.479 --> 00:04:24.830 align:start position:0% create those those price models manually which<00:04:22.320> is<00:04:22.560> kind<00:04:22.979> of<00:04:23.100> tricky<00:04:23.699> right 00:04:24.830 --> 00:04:24.840 align:start position:0% which is kind of tricky right 00:04:24.840 --> 00:04:26.990 align:start position:0% which is kind of tricky right uh<00:04:25.620> all<00:04:25.860> right<00:04:26.040> so<00:04:26.340> some<00:04:26.520> assumptions 00:04:26.990 --> 00:04:27.000 align:start position:0% uh all right so some assumptions 00:04:27.000 --> 00:04:28.490 align:start position:0% uh all right so some assumptions selected<00:04:27.600> assumptions<00:04:28.020> what<00:04:28.320> we're 00:04:28.490 --> 00:04:28.500 align:start position:0% selected assumptions what we're 00:04:28.500 --> 00:04:30.890 align:start position:0% selected assumptions what we're discovering<00:04:28.860> in<00:04:29.100> here<00:04:29.280> so<00:04:30.060> this<00:04:30.600> is<00:04:30.720> only 00:04:30.890 --> 00:04:30.900 align:start position:0% discovering in here so this is only 00:04:30.900 --> 00:04:31.730 align:start position:0% discovering in here so this is only about 00:04:31.730 --> 00:04:31.740 align:start position:0% about 00:04:31.740 --> 00:04:34.249 align:start position:0% about how<00:04:32.280> we<00:04:32.400> generate<00:04:32.639> the<00:04:32.820> dot<00:04:33.060> query<00:04:33.240> volume<00:04:33.479> so 00:04:34.249 --> 00:04:34.259 align:start position:0% how we generate the dot query volume so 00:04:34.259 --> 00:04:36.950 align:start position:0% how we generate the dot query volume so we've<00:04:34.800> got<00:04:34.979> in<00:04:35.460> here<00:04:35.639> so<00:04:36.240> this<00:04:36.540> is<00:04:36.660> basically 00:04:36.950 --> 00:04:36.960 align:start position:0% we've got in here so this is basically 00:04:36.960 --> 00:04:40.550 align:start position:0% we've got in here so this is basically the<00:04:37.199> shape<00:04:37.440> that<00:04:37.860> that<00:04:38.040> we<00:04:38.639> we<00:04:38.880> model<00:04:39.419> so<00:04:40.199> the 00:04:40.550 --> 00:04:40.560 align:start position:0% the shape that that we we model so the 00:04:40.560 --> 00:04:43.010 align:start position:0% the shape that that we we model so the x-axis<00:04:41.100> there<00:04:41.460> is<00:04:41.580> this<00:04:41.699> price<00:04:42.000> query<00:04:42.840> price 00:04:43.010 --> 00:04:43.020 align:start position:0% x-axis there is this price query price 00:04:43.020 --> 00:04:45.950 align:start position:0% x-axis there is this price query price slash<00:04:43.440> this<00:04:43.740> is<00:04:43.860> a<00:04:44.040> budget<00:04:44.340> of<00:04:44.639> of<00:04:45.419> a<00:04:45.840> customer 00:04:45.950 --> 00:04:45.960 align:start position:0% slash this is a budget of of a customer 00:04:45.960 --> 00:04:48.110 align:start position:0% slash this is a budget of of a customer that<00:04:46.320> customers<00:04:46.680> are<00:04:46.919> saying<00:04:47.280> okay<00:04:47.460> this<00:04:48.060> is 00:04:48.110 --> 00:04:48.120 align:start position:0% that customers are saying okay this is 00:04:48.120 --> 00:04:50.210 align:start position:0% that customers are saying okay this is how<00:04:48.360> much<00:04:48.479> I<00:04:48.660> can<00:04:48.780> pay<00:04:48.900> for<00:04:49.139> that<00:04:49.320> query<00:04:49.560> this 00:04:50.210 --> 00:04:50.220 align:start position:0% how much I can pay for that query this 00:04:50.220 --> 00:04:52.310 align:start position:0% how much I can pay for that query this budget<00:04:50.520> is<00:04:50.699> unknown<00:04:51.120> right<00:04:51.660> that's<00:04:51.900> important 00:04:52.310 --> 00:04:52.320 align:start position:0% budget is unknown right that's important 00:04:52.320 --> 00:04:54.409 align:start position:0% budget is unknown right that's important then<00:04:53.160> it's<00:04:53.520> not<00:04:53.639> sharing<00:04:53.940> that<00:04:54.060> with<00:04:54.180> the 00:04:54.409 --> 00:04:54.419 align:start position:0% then it's not sharing that with the 00:04:54.419 --> 00:04:56.030 align:start position:0% then it's not sharing that with the agents<00:04:54.720> it's<00:04:54.960> not<00:04:55.199> sharing<00:04:55.500> that<00:04:55.620> with<00:04:55.740> the 00:04:56.030 --> 00:04:56.040 align:start position:0% agents it's not sharing that with the 00:04:56.040 --> 00:04:57.650 align:start position:0% agents it's not sharing that with the indexers<00:04:56.400> it's<00:04:56.580> something<00:04:56.759> that<00:04:57.060> that<00:04:57.540> that 00:04:57.650 --> 00:04:57.660 align:start position:0% indexers it's something that that that 00:04:57.660 --> 00:05:00.230 align:start position:0% indexers it's something that that that is<00:04:58.139> setting<00:04:58.500> on<00:04:59.100> its<00:04:59.340> own<00:04:59.460> so<00:05:00.000> this<00:05:00.120> is 00:05:00.230 --> 00:05:00.240 align:start position:0% is setting on its own so this is 00:05:00.240 --> 00:05:01.730 align:start position:0% is setting on its own so this is something<00:05:00.360> that<00:05:00.600> we<00:05:01.020> want<00:05:01.080> to<00:05:01.199> discover<00:05:01.380> right 00:05:01.730 --> 00:05:01.740 align:start position:0% something that we want to discover right 00:05:01.740 --> 00:05:03.350 align:start position:0% something that we want to discover right and<00:05:01.979> the<00:05:02.160> budget<00:05:02.520> can<00:05:02.699> move<00:05:02.820> right<00:05:03.060> from<00:05:03.240> left 00:05:03.350 --> 00:05:03.360 align:start position:0% and the budget can move right from left 00:05:03.360 --> 00:05:05.629 align:start position:0% and the budget can move right from left to<00:05:03.540> right<00:05:03.720> which<00:05:03.900> means<00:05:04.139> that<00:05:04.259> if<00:05:04.860> the<00:05:05.040> if<00:05:05.340> the 00:05:05.629 --> 00:05:05.639 align:start position:0% to right which means that if the if the 00:05:05.639 --> 00:05:09.110 align:start position:0% to right which means that if the if the if<00:05:06.240> the<00:05:06.360> indexer<00:05:06.720> was<00:05:06.900> set<00:05:07.160> its<00:05:08.160> price<00:05:08.400> its 00:05:09.110 --> 00:05:09.120 align:start position:0% if the indexer was set its price its 00:05:09.120 --> 00:05:11.629 align:start position:0% if the indexer was set its price its price<00:05:09.180> bit<00:05:09.479> higher<00:05:09.840> than<00:05:10.020> this<00:05:10.199> well<00:05:10.560> he<00:05:11.520> won't 00:05:11.629 --> 00:05:11.639 align:start position:0% price bit higher than this well he won't 00:05:11.639 --> 00:05:13.610 align:start position:0% price bit higher than this well he won't be<00:05:11.820> picked<00:05:12.120> right<00:05:12.300> also<00:05:13.139> there<00:05:13.259> is<00:05:13.440> some<00:05:13.500> kind 00:05:13.610 --> 00:05:13.620 align:start position:0% be picked right also there is some kind 00:05:13.620 --> 00:05:15.350 align:start position:0% be picked right also there is some kind of<00:05:13.680> like<00:05:13.740> a<00:05:13.919> noise<00:05:14.100> we<00:05:14.340> we<00:05:14.580> added<00:05:14.880> a<00:05:15.060> noise<00:05:15.180> to 00:05:15.350 --> 00:05:15.360 align:start position:0% of like a noise we we added a noise to 00:05:15.360 --> 00:05:18.530 align:start position:0% of like a noise we we added a noise to that<00:05:15.479> volume<00:05:15.720> to<00:05:16.020> that<00:05:16.199> query<00:05:16.560> volume<00:05:16.740> and 00:05:18.530 --> 00:05:18.540 align:start position:0% that volume to that query volume and 00:05:18.540 --> 00:05:20.450 align:start position:0% that volume to that query volume and important<00:05:19.380> is<00:05:19.560> to<00:05:19.740> know<00:05:19.860> that<00:05:20.160> there's 00:05:20.450 --> 00:05:20.460 align:start position:0% important is to know that there's 00:05:20.460 --> 00:05:22.670 align:start position:0% important is to know that there's there's<00:05:20.820> a<00:05:21.180> game<00:05:21.360> happening<00:05:21.840> right<00:05:22.020> in<00:05:22.440> here 00:05:22.670 --> 00:05:22.680 align:start position:0% there's a game happening right in here 00:05:22.680 --> 00:05:25.310 align:start position:0% there's a game happening right in here and<00:05:23.039> the<00:05:23.220> game<00:05:23.340> is<00:05:23.580> suraj's<00:05:24.360> goal<00:05:24.660> is<00:05:25.139> to 00:05:25.310 --> 00:05:25.320 align:start position:0% and the game is suraj's goal is to 00:05:25.320 --> 00:05:26.749 align:start position:0% and the game is suraj's goal is to maximize<00:05:25.800> the<00:05:25.979> revenue 00:05:26.749 --> 00:05:26.759 align:start position:0% maximize the revenue 00:05:26.759 --> 00:05:28.969 align:start position:0% maximize the revenue but<00:05:27.419> gateway's<00:05:28.199> goal<00:05:28.440> and<00:05:28.620> basically 00:05:28.969 --> 00:05:28.979 align:start position:0% but gateway's goal and basically 00:05:28.979 --> 00:05:31.010 align:start position:0% but gateway's goal and basically protocol<00:05:29.400> goal<00:05:29.820> is<00:05:30.240> actually<00:05:30.360> quality<00:05:30.840> of 00:05:31.010 --> 00:05:31.020 align:start position:0% protocol goal is actually quality of 00:05:31.020 --> 00:05:32.749 align:start position:0% protocol goal is actually quality of service<00:05:31.199> right<00:05:31.440> we<00:05:31.740> want<00:05:31.919> all<00:05:32.220> the<00:05:32.340> queries<00:05:32.580> to 00:05:32.749 --> 00:05:32.759 align:start position:0% service right we want all the queries to 00:05:32.759 --> 00:05:34.249 align:start position:0% service right we want all the queries to be<00:05:32.880> served<00:05:33.180> you<00:05:33.360> know 00:05:34.249 --> 00:05:34.259 align:start position:0% be served you know 00:05:34.259 --> 00:05:36.950 align:start position:0% be served you know uh<00:05:34.620> five<00:05:35.220> nines<00:05:35.639> and<00:05:35.820> so<00:05:35.940> on<00:05:36.060> right<00:05:36.240> so<00:05:36.600> there's 00:05:36.950 --> 00:05:36.960 align:start position:0% uh five nines and so on right so there's 00:05:36.960 --> 00:05:39.770 align:start position:0% uh five nines and so on right so there's a<00:05:37.259> game<00:05:37.380> happening<00:05:38.220> all<00:05:38.639> right<00:05:38.699> so<00:05:39.419> if<00:05:39.600> you 00:05:39.770 --> 00:05:39.780 align:start position:0% a game happening all right so if you 00:05:39.780 --> 00:05:41.270 align:start position:0% a game happening all right so if you know<00:05:39.900> how<00:05:40.020> model<00:05:40.320> let's<00:05:40.680> not<00:05:40.860> now<00:05:41.039> switch 00:05:41.270 --> 00:05:41.280 align:start position:0% know how model let's not now switch 00:05:41.280 --> 00:05:42.909 align:start position:0% know how model let's not now switch gears<00:05:41.639> to<00:05:41.699> reinforcement<00:05:42.180> learning<00:05:42.539> just 00:05:42.909 --> 00:05:42.919 align:start position:0% gears to reinforcement learning just 00:05:42.919 --> 00:05:46.129 align:start position:0% gears to reinforcement learning just one-on-one<00:05:43.919> most<00:05:44.580> classical<00:05:44.880> thing<00:05:45.240> so 00:05:46.129 --> 00:05:46.139 align:start position:0% one-on-one most classical thing so 00:05:46.139 --> 00:05:47.870 align:start position:0% one-on-one most classical thing so down<00:05:46.680> there<00:05:46.979> in<00:05:47.039> reinforcement<00:05:47.580> learning 00:05:47.870 --> 00:05:47.880 align:start position:0% down there in reinforcement learning 00:05:47.880 --> 00:05:50.029 align:start position:0% down there in reinforcement learning we've<00:05:48.060> got<00:05:48.180> two<00:05:48.360> main<00:05:48.479> entities<00:05:48.900> agents<00:05:49.860> and 00:05:50.029 --> 00:05:50.039 align:start position:0% we've got two main entities agents and 00:05:50.039 --> 00:05:51.890 align:start position:0% we've got two main entities agents and environments<00:05:50.699> agents<00:05:51.360> interacts<00:05:51.780> with 00:05:51.890 --> 00:05:51.900 align:start position:0% environments agents interacts with 00:05:51.900 --> 00:05:54.469 align:start position:0% environments agents interacts with environment<00:05:52.320> by<00:05:52.560> executing<00:05:53.160> an<00:05:53.340> action<00:05:53.580> then 00:05:54.469 --> 00:05:54.479 align:start position:0% environment by executing an action then 00:05:54.479 --> 00:05:56.749 align:start position:0% environment by executing an action then agents<00:05:55.440> actions<00:05:55.740> change<00:05:55.979> the<00:05:56.220> state<00:05:56.400> of<00:05:56.580> the 00:05:56.749 --> 00:05:56.759 align:start position:0% agents actions change the state of the 00:05:56.759 --> 00:05:58.850 align:start position:0% agents actions change the state of the environment<00:05:57.120> I<00:05:57.900> just<00:05:58.080> got<00:05:58.259> reward<00:05:58.620> in<00:05:58.800> the 00:05:58.850 --> 00:05:58.860 align:start position:0% environment I just got reward in the 00:05:58.860 --> 00:06:01.370 align:start position:0% environment I just got reward in the observations<00:05:59.280> after<00:05:59.820> after 00:06:01.370 --> 00:06:01.380 align:start position:0% observations after after 00:06:01.380 --> 00:06:06.409 align:start position:0% observations after after oh<00:06:02.100> okay<00:06:02.940> and<00:06:03.900> I<00:06:04.800> just<00:06:05.039> can<00:06:05.280> up<00:06:05.520> their<00:06:05.940> its 00:06:06.409 --> 00:06:06.419 align:start position:0% oh okay and I just can up their its 00:06:06.419 --> 00:06:09.170 align:start position:0% oh okay and I just can up their its policy<00:06:06.840> based<00:06:07.500> on<00:06:07.560> the<00:06:07.860> received<00:06:08.400> reward<00:06:08.639> in 00:06:09.170 --> 00:06:09.180 align:start position:0% policy based on the received reward in 00:06:09.180 --> 00:06:11.029 align:start position:0% policy based on the received reward in short<00:06:09.360> that's<00:06:09.600> reinforcement<00:06:10.139> learning<00:06:10.500> so 00:06:11.029 --> 00:06:11.039 align:start position:0% short that's reinforcement learning so 00:06:11.039 --> 00:06:12.529 align:start position:0% short that's reinforcement learning so we're<00:06:11.160> using<00:06:11.520> different<00:06:11.639> types<00:06:11.940> of<00:06:12.060> agents<00:06:12.479> in 00:06:12.529 --> 00:06:12.539 align:start position:0% we're using different types of agents in 00:06:12.539 --> 00:06:16.129 align:start position:0% we're using different types of agents in our<00:06:12.720> simulations<00:06:13.280> uh<00:06:14.280> in<00:06:14.940> here<00:06:15.120> I<00:06:15.360> put<00:06:15.539> two 00:06:16.129 --> 00:06:16.139 align:start position:0% our simulations uh in here I put two 00:06:16.139 --> 00:06:17.930 align:start position:0% our simulations uh in here I put two most<00:06:16.320> important<00:06:16.740> criterions<00:06:17.220> one<00:06:17.699> are 00:06:17.930 --> 00:06:17.940 align:start position:0% most important criterions one are 00:06:17.940 --> 00:06:19.610 align:start position:0% most important criterions one are trainable<00:06:18.419> reinforcement<00:06:19.139> learning<00:06:19.500> online 00:06:19.610 --> 00:06:19.620 align:start position:0% trainable reinforcement learning online 00:06:19.620 --> 00:06:21.409 align:start position:0% trainable reinforcement learning online learning<00:06:20.100> and<00:06:20.400> the<00:06:20.520> other<00:06:20.639> ones<00:06:20.940> are<00:06:21.120> like 00:06:21.409 --> 00:06:21.419 align:start position:0% learning and the other ones are like 00:06:21.419 --> 00:06:23.270 align:start position:0% learning and the other ones are like rule<00:06:21.900> based<00:06:22.199> so<00:06:22.319> there<00:06:22.560> are<00:06:22.680> some<00:06:22.800> predefined 00:06:23.270 --> 00:06:23.280 align:start position:0% rule based so there are some predefined 00:06:23.280 --> 00:06:26.210 align:start position:0% rule based so there are some predefined behaviors<00:06:23.699> and<00:06:24.660> also<00:06:25.020> we've<00:06:25.259> got<00:06:25.319> this<00:06:25.979> second 00:06:26.210 --> 00:06:26.220 align:start position:0% behaviors and also we've got this second 00:06:26.220 --> 00:06:28.730 align:start position:0% behaviors and also we've got this second Criterion<00:06:26.940> Solutions<00:06:27.660> can<00:06:27.900> be<00:06:28.020> stochastic<00:06:28.380> or 00:06:28.730 --> 00:06:28.740 align:start position:0% Criterion Solutions can be stochastic or 00:06:28.740 --> 00:06:30.010 align:start position:0% Criterion Solutions can be stochastic or deterministic 00:06:30.010 --> 00:06:30.020 align:start position:0% deterministic 00:06:30.020 --> 00:06:32.809 align:start position:0% deterministic in<00:06:31.020> here<00:06:31.199> I<00:06:31.380> put<00:06:31.560> some 00:06:32.809 --> 00:06:32.819 align:start position:0% in here I put some 00:06:32.819 --> 00:06:36.590 align:start position:0% in here I put some some<00:06:33.539> simplified<00:06:34.080> classification<00:06:34.860> of<00:06:35.160> of<00:06:35.600> the 00:06:36.590 --> 00:06:36.600 align:start position:0% some simplified classification of of the 00:06:36.600 --> 00:06:38.809 align:start position:0% some simplified classification of of the reinforcement<00:06:37.199> learning<00:06:37.680> algorithms<00:06:38.100> and<00:06:38.699> I 00:06:38.809 --> 00:06:38.819 align:start position:0% reinforcement learning algorithms and I 00:06:38.819 --> 00:06:40.610 align:start position:0% reinforcement learning algorithms and I highlighted<00:06:39.300> the<00:06:39.479> two<00:06:39.600> that<00:06:39.840> basically<00:06:40.380> we 00:06:40.610 --> 00:06:40.620 align:start position:0% highlighted the two that basically we 00:06:40.620 --> 00:06:42.170 align:start position:0% highlighted the two that basically we will<00:06:40.860> be<00:06:40.979> using<00:06:41.220> in<00:06:41.340> our<00:06:41.460> simulation<00:06:41.759> so<00:06:42.060> we'll 00:06:42.170 --> 00:06:42.180 align:start position:0% will be using in our simulation so we'll 00:06:42.180 --> 00:06:44.029 align:start position:0% will be using in our simulation so we'll be<00:06:42.360> using<00:06:42.720> vanilla<00:06:43.139> policy<00:06:43.440> gradients<00:06:43.919> and 00:06:44.029 --> 00:06:44.039 align:start position:0% be using vanilla policy gradients and 00:06:44.039 --> 00:06:45.950 align:start position:0% be using vanilla policy gradients and mostly<00:06:44.400> most<00:06:44.639> of<00:06:44.819> our<00:06:44.940> agents<00:06:45.479> will<00:06:45.600> be<00:06:45.720> using 00:06:45.950 --> 00:06:45.960 align:start position:0% mostly most of our agents will be using 00:06:45.960 --> 00:06:46.909 align:start position:0% mostly most of our agents will be using PPL 00:06:46.909 --> 00:06:46.919 align:start position:0% PPL 00:06:46.919 --> 00:06:48.469 align:start position:0% PPL important 00:06:48.469 --> 00:06:48.479 align:start position:0% important 00:06:48.479 --> 00:06:50.629 align:start position:0% important there<00:06:49.020> is<00:06:49.139> one<00:06:49.380> important<00:06:49.979> type<00:06:50.220> of<00:06:50.400> ideas 00:06:50.629 --> 00:06:50.639 align:start position:0% there is one important type of ideas 00:06:50.639 --> 00:06:52.790 align:start position:0% there is one important type of ideas that<00:06:51.120> actually<00:06:51.240> we<00:06:51.600> we<00:06:51.900> are<00:06:52.080> mostly<00:06:52.380> focusing 00:06:52.790 --> 00:06:52.800 align:start position:0% that actually we we are mostly focusing 00:06:52.800 --> 00:06:55.670 align:start position:0% that actually we we are mostly focusing which<00:06:53.759> are<00:06:53.940> we<00:06:54.180> call<00:06:54.479> them<00:06:54.660> gaussian<00:06:55.080> Bandits 00:06:55.670 --> 00:06:55.680 align:start position:0% which are we call them gaussian Bandits 00:06:55.680 --> 00:06:58.850 align:start position:0% which are we call them gaussian Bandits so<00:06:56.280> the<00:06:56.520> idea<00:06:56.819> that<00:06:57.060> this<00:06:57.180> is<00:06:57.300> sustainable<00:06:57.860> uh 00:06:58.850 --> 00:06:58.860 align:start position:0% so the idea that this is sustainable uh 00:06:58.860 --> 00:07:00.590 align:start position:0% so the idea that this is sustainable uh stochastic<00:06:59.280> agent<00:06:59.699> with<00:06:59.880> policy<00:07:00.300> that<00:07:00.479> is 00:07:00.590 --> 00:07:00.600 align:start position:0% stochastic agent with policy that is 00:07:00.600 --> 00:07:03.170 align:start position:0% stochastic agent with policy that is represented<00:07:01.199> with<00:07:01.620> a<00:07:01.979> gaussian<00:07:02.400> and<00:07:03.060> then 00:07:03.170 --> 00:07:03.180 align:start position:0% represented with a gaussian and then 00:07:03.180 --> 00:07:05.090 align:start position:0% represented with a gaussian and then when<00:07:03.419> an<00:07:03.600> agent<00:07:03.960> is<00:07:04.080> is<00:07:04.440> supposed<00:07:04.740> to<00:07:04.919> perform 00:07:05.090 --> 00:07:05.100 align:start position:0% when an agent is is supposed to perform 00:07:05.100 --> 00:07:06.529 align:start position:0% when an agent is is supposed to perform an<00:07:05.400> action<00:07:05.639> in<00:07:05.880> something<00:07:06.120> from<00:07:06.360> that 00:07:06.529 --> 00:07:06.539 align:start position:0% an action in something from that 00:07:06.539 --> 00:07:08.150 align:start position:0% an action in something from that gaussian<00:07:07.020> right<00:07:07.199> so<00:07:07.259> imagine<00:07:07.500> that<00:07:07.800> there<00:07:08.039> is 00:07:08.150 --> 00:07:08.160 align:start position:0% gaussian right so imagine that there is 00:07:08.160 --> 00:07:10.790 align:start position:0% gaussian right so imagine that there is this<00:07:08.280> distribution<00:07:08.720> and<00:07:09.720> when<00:07:10.199> that<00:07:10.380> when<00:07:10.680> the 00:07:10.790 --> 00:07:10.800 align:start position:0% this distribution and when that when the 00:07:10.800 --> 00:07:12.710 align:start position:0% this distribution and when that when the digest<00:07:11.160> is<00:07:11.580> supposed<00:07:11.759> to<00:07:11.940> make<00:07:12.300> an<00:07:12.539> action 00:07:12.710 --> 00:07:12.720 align:start position:0% digest is supposed to make an action 00:07:12.720 --> 00:07:15.710 align:start position:0% digest is supposed to make an action it's<00:07:13.259> just<00:07:13.500> sampling<00:07:13.860> right<00:07:14.240> and<00:07:15.240> in<00:07:15.600> this 00:07:15.710 --> 00:07:15.720 align:start position:0% it's just sampling right and in this 00:07:15.720 --> 00:07:18.650 align:start position:0% it's just sampling right and in this case<00:07:15.900> Okay<00:07:16.380> the<00:07:16.919> agent<00:07:17.220> sample<00:07:17.520> is<00:07:17.580> 0.8<00:07:18.060> and 00:07:18.650 --> 00:07:18.660 align:start position:0% case Okay the agent sample is 0.8 and 00:07:18.660 --> 00:07:20.450 align:start position:0% case Okay the agent sample is 0.8 and from<00:07:18.960> that<00:07:19.139> blue<00:07:19.319> distribution<00:07:19.800> second<00:07:20.039> agent 00:07:20.450 --> 00:07:20.460 align:start position:0% from that blue distribution second agent 00:07:20.460 --> 00:07:24.650 align:start position:0% from that blue distribution second agent sampled<00:07:20.819> python<00:07:21.660> 24<00:07:22.199> right<00:07:22.639> and<00:07:23.639> why<00:07:24.120> Bandit 00:07:24.650 --> 00:07:24.660 align:start position:0% sampled python 24 right and why Bandit 00:07:24.660 --> 00:07:26.330 align:start position:0% sampled python 24 right and why Bandit Bandit<00:07:25.259> is<00:07:25.380> because<00:07:25.560> the<00:07:25.740> agent<00:07:25.979> is<00:07:26.099> not 00:07:26.330 --> 00:07:26.340 align:start position:0% Bandit is because the agent is not 00:07:26.340 --> 00:07:27.950 align:start position:0% Bandit is because the agent is not building<00:07:26.460> any<00:07:26.819> an<00:07:27.120> internal<00:07:27.479> model<00:07:27.660> an 00:07:27.950 --> 00:07:27.960 align:start position:0% building any an internal model an 00:07:27.960 --> 00:07:29.210 align:start position:0% building any an internal model an internal<00:07:28.319> representation<00:07:28.800> of<00:07:29.039> the 00:07:29.210 --> 00:07:29.220 align:start position:0% internal representation of the 00:07:29.220 --> 00:07:30.350 align:start position:0% internal representation of the environment 00:07:30.350 --> 00:07:30.360 align:start position:0% environment 00:07:30.360 --> 00:07:33.589 align:start position:0% environment all<00:07:31.020> right<00:07:31.199> so<00:07:31.979> going<00:07:32.400> to<00:07:32.639> the<00:07:32.940> most<00:07:33.120> important 00:07:33.589 --> 00:07:33.599 align:start position:0% all right so going to the most important 00:07:33.599 --> 00:07:36.770 align:start position:0% all right so going to the most important part<00:07:33.840> so<00:07:34.139> testing<00:07:34.680> based<00:07:35.360> testing<00:07:36.360> properties 00:07:36.770 --> 00:07:36.780 align:start position:0% part so testing based testing properties 00:07:36.780 --> 00:07:38.930 align:start position:0% part so testing based testing properties with<00:07:37.020> edges-based<00:07:37.979> modeling 00:07:38.930 --> 00:07:38.940 align:start position:0% with edges-based modeling 00:07:38.940 --> 00:07:40.430 align:start position:0% with edges-based modeling so<00:07:39.360> in<00:07:39.599> here 00:07:40.430 --> 00:07:40.440 align:start position:0% so in here 00:07:40.440 --> 00:07:44.570 align:start position:0% so in here so<00:07:41.160> already<00:07:41.580> kind<00:07:42.000> of<00:07:42.120> explain<00:07:42.599> this<00:07:43.020> but<00:07:43.919> in 00:07:44.570 --> 00:07:44.580 align:start position:0% so already kind of explain this but in 00:07:44.580 --> 00:07:46.610 align:start position:0% so already kind of explain this but in the<00:07:44.759> first<00:07:44.880> set<00:07:45.240> of<00:07:45.419> experiments<00:07:45.960> we<00:07:46.139> focus<00:07:46.380> on 00:07:46.610 --> 00:07:46.620 align:start position:0% the first set of experiments we focus on 00:07:46.620 --> 00:07:49.070 align:start position:0% the first set of experiments we focus on single<00:07:46.919> agent<00:07:47.220> simulation<00:07:47.639> just<00:07:48.479> testing<00:07:48.960> the 00:07:49.070 --> 00:07:49.080 align:start position:0% single agent simulation just testing the 00:07:49.080 --> 00:07:51.890 align:start position:0% single agent simulation just testing the properties<00:07:49.440> of<00:07:49.620> an<00:07:49.800> agent<00:07:50.099> and<00:07:51.060> this<00:07:51.599> is<00:07:51.720> a 00:07:51.890 --> 00:07:51.900 align:start position:0% properties of an agent and this is a 00:07:51.900 --> 00:07:54.350 align:start position:0% properties of an agent and this is a single<00:07:52.259> gaussian<00:07:52.800> Bandit<00:07:53.160> with<00:07:53.819> a<00:07:54.060> modified 00:07:54.350 --> 00:07:54.360 align:start position:0% single gaussian Bandit with a modified 00:07:54.360 --> 00:07:58.370 align:start position:0% single gaussian Bandit with a modified PPO<00:07:54.900> policy<00:07:55.880> update<00:07:56.880> Rule<00:07:57.180> and<00:07:57.840> the<00:07:58.139> query 00:07:58.370 --> 00:07:58.380 align:start position:0% PPO policy update Rule and the query 00:07:58.380 --> 00:08:00.890 align:start position:0% PPO policy update Rule and the query distributor<00:07:58.919> is<00:07:59.039> like<00:07:59.520> a<00:07:59.759> super<00:07:59.940> naive<00:08:00.479> you 00:08:00.890 --> 00:08:00.900 align:start position:0% distributor is like a super naive you 00:08:00.900 --> 00:08:04.249 align:start position:0% distributor is like a super naive you know<00:08:01.020> let's<00:08:01.800> say<00:08:02.419> version<00:08:03.419> of<00:08:03.660> that<00:08:03.900> what 00:08:04.249 --> 00:08:04.259 align:start position:0% know let's say version of that what 00:08:04.259 --> 00:08:05.450 align:start position:0% know let's say version of that what could<00:08:04.380> happen<00:08:04.560> if<00:08:04.800> here<00:08:04.979> is<00:08:05.099> that<00:08:05.160> we've<00:08:05.400> got 00:08:05.450 --> 00:08:05.460 align:start position:0% could happen if here is that we've got 00:08:05.460 --> 00:08:07.490 align:start position:0% could happen if here is that we've got access<00:08:05.699> okay<00:08:06.240> depending<00:08:07.139> on<00:08:07.259> the<00:08:07.380> price 00:08:07.490 --> 00:08:07.500 align:start position:0% access okay depending on the price 00:08:07.500 --> 00:08:09.290 align:start position:0% access okay depending on the price business<00:08:07.800> is<00:08:08.160> just<00:08:08.340> inverse<00:08:08.819> inversely 00:08:09.290 --> 00:08:09.300 align:start position:0% business is just inverse inversely 00:08:09.300 --> 00:08:11.689 align:start position:0% business is just inverse inversely proportional<00:08:09.900> and<00:08:10.740> in<00:08:10.979> the<00:08:11.160> first<00:08:11.220> step<00:08:11.400> we've 00:08:11.689 --> 00:08:11.699 align:start position:0% proportional and in the first step we've 00:08:11.699 --> 00:08:13.550 align:start position:0% proportional and in the first step we've got<00:08:11.819> a<00:08:12.000> fixed<00:08:12.300> customer<00:08:12.419> budget<00:08:13.020> with<00:08:13.319> some 00:08:13.550 --> 00:08:13.560 align:start position:0% got a fixed customer budget with some 00:08:13.560 --> 00:08:16.430 align:start position:0% got a fixed customer budget with some noise<00:08:13.740> of<00:08:14.099> course<00:08:14.220> right<00:08:15.020> and<00:08:16.020> what<00:08:16.199> we<00:08:16.319> are 00:08:16.430 --> 00:08:16.440 align:start position:0% noise of course right and what we are 00:08:16.440 --> 00:08:18.230 align:start position:0% noise of course right and what we are checking<00:08:16.800> in<00:08:16.979> here<00:08:17.220> is<00:08:17.520> the<00:08:17.699> following<00:08:18.000> we've 00:08:18.230 --> 00:08:18.240 align:start position:0% checking in here is the following we've 00:08:18.240 --> 00:08:19.790 align:start position:0% checking in here is the following we've got<00:08:18.360> market<00:08:18.660> conditions<00:08:19.259> we've<00:08:19.500> got<00:08:19.620> two 00:08:19.790 --> 00:08:19.800 align:start position:0% got market conditions we've got two 00:08:19.800 --> 00:08:21.409 align:start position:0% got market conditions we've got two criterias<00:08:20.280> for<00:08:20.460> every<00:08:20.580> experimental<00:08:21.180> custom 00:08:21.409 --> 00:08:21.419 align:start position:0% criterias for every experimental custom 00:08:21.419 --> 00:08:23.570 align:start position:0% criterias for every experimental custom criteria<00:08:21.960> and<00:08:22.379> a<00:08:22.500> property<00:08:22.860> that<00:08:23.220> we<00:08:23.340> want<00:08:23.460> to 00:08:23.570 --> 00:08:23.580 align:start position:0% criteria and a property that we want to 00:08:23.580 --> 00:08:25.249 align:start position:0% criteria and a property that we want to test<00:08:23.759> whether<00:08:24.060> the<00:08:24.240> Bandit<00:08:24.599> is<00:08:24.780> fulfilling 00:08:25.249 --> 00:08:25.259 align:start position:0% test whether the Bandit is fulfilling 00:08:25.259 --> 00:08:27.710 align:start position:0% test whether the Bandit is fulfilling that<00:08:25.860> that<00:08:25.919> Criterium<00:08:26.580> is<00:08:26.879> is<00:08:27.060> operating<00:08:27.479> the 00:08:27.710 --> 00:08:27.720 align:start position:0% that that Criterium is is operating the 00:08:27.720 --> 00:08:29.809 align:start position:0% that that Criterium is is operating the way<00:08:27.900> we<00:08:28.139> want<00:08:28.319> or<00:08:28.500> not<00:08:28.680> in<00:08:29.160> this<00:08:29.280> case<00:08:29.400> the 00:08:29.809 --> 00:08:29.819 align:start position:0% way we want or not in this case the 00:08:29.819 --> 00:08:32.690 align:start position:0% way we want or not in this case the Criterion<00:08:30.240> is<00:08:30.419> customer<00:08:30.599> budget<00:08:31.080> discovery 00:08:32.690 --> 00:08:32.700 align:start position:0% Criterion is customer budget discovery 00:08:32.700 --> 00:08:35.570 align:start position:0% Criterion is customer budget discovery as<00:08:33.180> I've<00:08:33.419> highlighted<00:08:33.899> before<00:08:34.159> and<00:08:35.159> the 00:08:35.570 --> 00:08:35.580 align:start position:0% as I've highlighted before and the 00:08:35.580 --> 00:08:36.709 align:start position:0% as I've highlighted before and the Agents 00:08:36.709 --> 00:08:36.719 align:start position:0% Agents 00:08:36.719 --> 00:08:39.170 align:start position:0% Agents do<00:08:37.260> not<00:08:37.440> know<00:08:37.620> the<00:08:37.979> budgets<00:08:38.399> right<00:08:38.520> but<00:08:38.880> so<00:08:39.060> we 00:08:39.170 --> 00:08:39.180 align:start position:0% do not know the budgets right but so we 00:08:39.180 --> 00:08:41.329 align:start position:0% do not know the budgets right but so we want<00:08:39.300> to<00:08:39.419> discover<00:08:39.599> that 00:08:41.329 --> 00:08:41.339 align:start position:0% want to discover that 00:08:41.339 --> 00:08:43.250 align:start position:0% want to discover that so<00:08:41.820> first<00:08:42.000> so 00:08:43.250 --> 00:08:43.260 align:start position:0% so first so 00:08:43.260 --> 00:08:45.170 align:start position:0% so first so that's<00:08:43.919> there<00:08:44.459> will<00:08:44.640> be<00:08:44.700> lots<00:08:44.940> of<00:08:45.000> things 00:08:45.170 --> 00:08:45.180 align:start position:0% that's there will be lots of things 00:08:45.180 --> 00:08:47.150 align:start position:0% that's there will be lots of things happening<00:08:45.600> right<00:08:45.779> because<00:08:46.440> we<00:08:46.680> are<00:08:46.800> tracking 00:08:47.150 --> 00:08:47.160 align:start position:0% happening right because we are tracking 00:08:47.160 --> 00:08:48.530 align:start position:0% happening right because we are tracking many<00:08:47.339> things<00:08:47.519> there<00:08:47.700> are<00:08:47.820> in<00:08:47.940> simulations<00:08:48.240> so 00:08:48.530 --> 00:08:48.540 align:start position:0% many things there are in simulations so 00:08:48.540 --> 00:08:51.650 align:start position:0% many things there are in simulations so let<00:08:48.660> me<00:08:48.839> try<00:08:49.080> to<00:08:49.260> let's<00:08:50.040> say<00:08:50.279> unfold<00:08:51.060> that<00:08:51.300> and 00:08:51.650 --> 00:08:51.660 align:start position:0% let me try to let's say unfold that and 00:08:51.660 --> 00:08:53.990 align:start position:0% let me try to let's say unfold that and go<00:08:51.839> step<00:08:52.200> by<00:08:52.380> step<00:08:52.560> explaining<00:08:53.519> what<00:08:53.700> you<00:08:53.880> will 00:08:53.990 --> 00:08:54.000 align:start position:0% go step by step explaining what you will 00:08:54.000 --> 00:08:55.670 align:start position:0% go step by step explaining what you will be<00:08:54.180> seeing<00:08:54.360> in<00:08:54.540> a<00:08:54.660> moment<00:08:54.839> in<00:08:55.080> in<00:08:55.260> those 00:08:55.670 --> 00:08:55.680 align:start position:0% be seeing in a moment in in those 00:08:55.680 --> 00:08:57.470 align:start position:0% be seeing in a moment in in those animations<00:08:56.160> in<00:08:56.459> those<00:08:56.580> videos<00:08:56.880> that<00:08:57.360> we 00:08:57.470 --> 00:08:57.480 align:start position:0% animations in those videos that we 00:08:57.480 --> 00:08:59.570 align:start position:0% animations in those videos that we captured<00:08:57.839> during<00:08:57.959> the<00:08:58.200> experiments<00:08:58.740> so<00:08:59.339> first 00:08:59.570 --> 00:08:59.580 align:start position:0% captured during the experiments so first 00:08:59.580 --> 00:09:01.790 align:start position:0% captured during the experiments so first there<00:09:00.000> are<00:09:00.300> five<00:09:00.480> plots<00:09:00.839> right<00:09:01.140> in<00:09:01.380> a<00:09:01.560> single 00:09:01.790 --> 00:09:01.800 align:start position:0% there are five plots right in a single 00:09:01.800 --> 00:09:04.850 align:start position:0% there are five plots right in a single video<00:09:02.220> first<00:09:02.820> one<00:09:03.060> is<00:09:03.300> the<00:09:03.899> most<00:09:04.019> important<00:09:04.380> so 00:09:04.850 --> 00:09:04.860 align:start position:0% video first one is the most important so 00:09:04.860 --> 00:09:06.889 align:start position:0% video first one is the most important so what<00:09:05.100> we've<00:09:05.279> got<00:09:05.459> in<00:09:05.580> here<00:09:05.820> is<00:09:06.060> the<00:09:06.300> is<00:09:06.720> that 00:09:06.889 --> 00:09:06.899 align:start position:0% what we've got in here is the is that 00:09:06.899 --> 00:09:08.269 align:start position:0% what we've got in here is the is that budget<00:09:07.260> right 00:09:08.269 --> 00:09:08.279 align:start position:0% budget right 00:09:08.279 --> 00:09:09.829 align:start position:0% budget right the<00:09:08.700> query<00:09:08.880> Volume<00:09:09.120> Plus<00:09:09.360> Plus<00:09:09.600> customer 00:09:09.829 --> 00:09:09.839 align:start position:0% the query Volume Plus Plus customer 00:09:09.839 --> 00:09:13.370 align:start position:0% the query Volume Plus Plus customer budget<00:09:10.440> the<00:09:11.160> solid<00:09:11.519> red<00:09:11.700> line<00:09:12.000> is<00:09:12.839> the<00:09:12.959> agent's 00:09:13.370 --> 00:09:13.380 align:start position:0% budget the solid red line is the agent's 00:09:13.380 --> 00:09:15.470 align:start position:0% budget the solid red line is the agent's current<00:09:13.500> policy<00:09:14.040> the<00:09:14.700> dashed<00:09:15.060> line<00:09:15.120> is<00:09:15.360> the 00:09:15.470 --> 00:09:15.480 align:start position:0% current policy the dashed line is the 00:09:15.480 --> 00:09:16.970 align:start position:0% current policy the dashed line is the initial<00:09:15.720> policy<00:09:16.140> that<00:09:16.320> that<00:09:16.440> agent<00:09:16.800> is 00:09:16.970 --> 00:09:16.980 align:start position:0% initial policy that that agent is 00:09:16.980 --> 00:09:18.370 align:start position:0% initial policy that that agent is starting<00:09:17.160> from 00:09:18.370 --> 00:09:18.380 align:start position:0% starting from 00:09:18.380 --> 00:09:21.650 align:start position:0% starting from second<00:09:19.380> in<00:09:20.279> the<00:09:20.399> second<00:09:20.519> plot<00:09:20.820> from<00:09:21.060> from<00:09:21.300> the 00:09:21.650 --> 00:09:21.660 align:start position:0% second in the second plot from from the 00:09:21.660 --> 00:09:23.449 align:start position:0% second in the second plot from from the top<00:09:21.779> this<00:09:22.560> is<00:09:22.680> basically<00:09:22.980> query<00:09:23.220> volume 00:09:23.449 --> 00:09:23.459 align:start position:0% top this is basically query volume 00:09:23.459 --> 00:09:25.490 align:start position:0% top this is basically query volume server<00:09:23.940> by<00:09:24.000> the<00:09:24.180> agent<00:09:24.420> at<00:09:24.600> that<00:09:25.019> given<00:09:25.320> time 00:09:25.490 --> 00:09:25.500 align:start position:0% server by the agent at that given time 00:09:25.500 --> 00:09:28.250 align:start position:0% server by the agent at that given time step<00:09:25.740> so<00:09:26.160> what<00:09:26.339> happened<00:09:26.519> in<00:09:26.760> here<00:09:27.000> is<00:09:27.779> Agent 00:09:28.250 --> 00:09:28.260 align:start position:0% step so what happened in here is Agent 00:09:28.260 --> 00:09:29.990 align:start position:0% step so what happened in here is Agent actually<00:09:28.500> didn't<00:09:28.980> serve<00:09:29.399> a<00:09:29.459> query<00:09:29.760> right 00:09:29.990 --> 00:09:30.000 align:start position:0% actually didn't serve a query right 00:09:30.000 --> 00:09:32.150 align:start position:0% actually didn't serve a query right didn't<00:09:30.240> get<00:09:30.540> any<00:09:30.660> queries<00:09:31.019> because<00:09:31.260> it's<00:09:31.920> he 00:09:32.150 --> 00:09:32.160 align:start position:0% didn't get any queries because it's he 00:09:32.160 --> 00:09:33.889 align:start position:0% didn't get any queries because it's he sampled<00:09:32.519> somewhere<00:09:32.880> in<00:09:33.060> here<00:09:33.180> right<00:09:33.360> like<00:09:33.660> few 00:09:33.889 --> 00:09:33.899 align:start position:0% sampled somewhere in here right like few 00:09:33.899 --> 00:09:36.230 align:start position:0% sampled somewhere in here right like few steps<00:09:34.200> ago<00:09:34.440> he<00:09:34.860> sampled<00:09:35.220> some<00:09:35.519> like<00:09:35.880> the<00:09:36.240> the 00:09:36.230 --> 00:09:36.240 align:start position:0% steps ago he sampled some like the the 00:09:36.240 --> 00:09:38.269 align:start position:0% steps ago he sampled some like the the the<00:09:36.360> price<00:09:36.899> was<00:09:37.140> too<00:09:37.380> high<00:09:37.560> right<00:09:37.860> so<00:09:38.100> the 00:09:38.269 --> 00:09:38.279 align:start position:0% the price was too high right so the 00:09:38.279 --> 00:09:40.610 align:start position:0% the price was too high right so the agent<00:09:38.519> didn't<00:09:38.700> get<00:09:38.820> any<00:09:38.940> queries<00:09:39.300> so 00:09:40.610 --> 00:09:40.620 align:start position:0% agent didn't get any queries so 00:09:40.620 --> 00:09:42.050 align:start position:0% agent didn't get any queries so which 00:09:42.050 --> 00:09:42.060 align:start position:0% which 00:09:42.060 --> 00:09:44.389 align:start position:0% which which<00:09:42.540> also<00:09:42.959> is<00:09:43.080> shown<00:09:43.260> in<00:09:43.500> here<00:09:43.740> so<00:09:44.040> this<00:09:44.279> is 00:09:44.389 --> 00:09:44.399 align:start position:0% which also is shown in here so this is 00:09:44.399 --> 00:09:46.670 align:start position:0% which also is shown in here so this is the<00:09:44.700> aggregated<00:09:45.300> query<00:09:45.600> volume<00:09:45.839> served<00:09:46.260> by<00:09:46.380> a 00:09:46.670 --> 00:09:46.680 align:start position:0% the aggregated query volume served by a 00:09:46.680 --> 00:09:48.710 align:start position:0% the aggregated query volume served by a given<00:09:46.920> agent<00:09:47.160> in<00:09:47.399> red<00:09:47.580> and<00:09:48.060> the<00:09:48.240> blue<00:09:48.360> ones 00:09:48.710 --> 00:09:48.720 align:start position:0% given agent in red and the blue ones 00:09:48.720 --> 00:09:50.630 align:start position:0% given agent in red and the blue ones shows<00:09:49.140> basically<00:09:49.740> how<00:09:49.980> many<00:09:50.100> queries<00:09:50.459> were 00:09:50.630 --> 00:09:50.640 align:start position:0% shows basically how many queries were 00:09:50.640 --> 00:09:52.670 align:start position:0% shows basically how many queries were dropped<00:09:51.060> weren't<00:09:51.480> served<00:09:51.839> at<00:09:51.959> all<00:09:52.080> right<00:09:52.380> so 00:09:52.670 --> 00:09:52.680 align:start position:0% dropped weren't served at all right so 00:09:52.680 --> 00:09:55.009 align:start position:0% dropped weren't served at all right so you<00:09:52.860> can<00:09:52.980> see<00:09:53.100> in<00:09:53.220> here<00:09:53.399> there's<00:09:53.640> a<00:09:53.880> tiny<00:09:54.240> tiny 00:09:55.009 --> 00:09:55.019 align:start position:0% you can see in here there's a tiny tiny 00:09:55.019 --> 00:09:57.050 align:start position:0% you can see in here there's a tiny tiny step<00:09:55.200> which<00:09:55.980> is<00:09:56.100> which<00:09:56.459> actually<00:09:56.760> is 00:09:57.050 --> 00:09:57.060 align:start position:0% step which is which actually is 00:09:57.060 --> 00:09:59.269 align:start position:0% step which is which actually is associated<00:09:57.420> with<00:09:57.720> this<00:09:57.959> then<00:09:58.740> in<00:09:59.040> the<00:09:59.160> next 00:09:59.269 --> 00:09:59.279 align:start position:0% associated with this then in the next 00:09:59.279 --> 00:10:01.970 align:start position:0% associated with this then in the next plot<00:09:59.640> we've<00:10:00.180> got<00:10:00.300> agents<00:10:00.839> revenue<00:10:01.140> and 00:10:01.970 --> 00:10:01.980 align:start position:0% plot we've got agents revenue and 00:10:01.980 --> 00:10:04.070 align:start position:0% plot we've got agents revenue and aggregated<00:10:02.459> agents<00:10:03.000> Revenue<00:10:03.240> over<00:10:03.420> time<00:10:03.720> all 00:10:04.070 --> 00:10:04.080 align:start position:0% aggregated agents Revenue over time all 00:10:04.080 --> 00:10:05.150 align:start position:0% aggregated agents Revenue over time all right 00:10:05.150 --> 00:10:05.160 align:start position:0% right 00:10:05.160 --> 00:10:08.210 align:start position:0% right so<00:10:05.700> let's<00:10:06.420> run<00:10:06.660> our<00:10:06.899> first<00:10:07.080> experiment<00:10:07.980> right 00:10:08.210 --> 00:10:08.220 align:start position:0% so let's run our first experiment right 00:10:08.220 --> 00:10:10.130 align:start position:0% so let's run our first experiment right so<00:10:08.760> once<00:10:09.000> again<00:10:09.060> what<00:10:09.420> we<00:10:09.540> are<00:10:09.720> testing<00:10:09.959> in 00:10:10.130 --> 00:10:10.140 align:start position:0% so once again what we are testing in 00:10:10.140 --> 00:10:11.690 align:start position:0% so once again what we are testing in here<00:10:10.320> what<00:10:10.560> we<00:10:10.680> are<00:10:10.800> trying<00:10:10.980> to<00:10:11.100> discover<00:10:11.339> is 00:10:11.690 --> 00:10:11.700 align:start position:0% here what we are trying to discover is 00:10:11.700 --> 00:10:13.730 align:start position:0% here what we are trying to discover is word<00:10:12.420> up<00:10:12.779> that 00:10:13.730 --> 00:10:13.740 align:start position:0% word up that 00:10:13.740 --> 00:10:17.810 align:start position:0% word up that where<00:10:14.339> that<00:10:14.640> that<00:10:14.880> budget<00:10:15.300> is<00:10:15.779> right<00:10:16.260> so 00:10:17.810 --> 00:10:17.820 align:start position:0% where that that budget is right so 00:10:17.820 --> 00:10:20.570 align:start position:0% where that that budget is right so as<00:10:18.360> agencies<00:10:18.839> is<00:10:18.959> learning<00:10:19.500> right<00:10:19.800> so<00:10:20.339> first 00:10:20.570 --> 00:10:20.580 align:start position:0% as agencies is learning right so first 00:10:20.580 --> 00:10:23.090 align:start position:0% as agencies is learning right so first the<00:10:20.820> gaussian<00:10:21.240> is<00:10:21.480> was<00:10:21.839> super<00:10:22.140> wide<00:10:22.500> right 00:10:23.090 --> 00:10:23.100 align:start position:0% the gaussian is was super wide right 00:10:23.100 --> 00:10:25.970 align:start position:0% the gaussian is was super wide right like<00:10:23.399> it<00:10:23.640> was<00:10:23.760> like<00:10:24.060> much<00:10:24.720> much<00:10:24.959> wider<00:10:25.440> and 00:10:25.970 --> 00:10:25.980 align:start position:0% like it was like much much wider and 00:10:25.980 --> 00:10:27.650 align:start position:0% like it was like much much wider and once<00:10:26.279> the<00:10:26.399> agent<00:10:26.760> as<00:10:27.120> you<00:10:27.300> can<00:10:27.420> see<00:10:27.480> it's 00:10:27.650 --> 00:10:27.660 align:start position:0% once the agent as you can see it's 00:10:27.660 --> 00:10:29.090 align:start position:0% once the agent as you can see it's something<00:10:27.899> from<00:10:28.200> time<00:10:28.320> to<00:10:28.440> time<00:10:28.620> somewhere<00:10:28.980> in 00:10:29.090 --> 00:10:29.100 align:start position:0% something from time to time somewhere in 00:10:29.100 --> 00:10:30.949 align:start position:0% something from time to time somewhere in here<00:10:29.220> right<00:10:29.459> above<00:10:29.940> the<00:10:30.120> budget<00:10:30.420> so<00:10:30.839> it's 00:10:30.949 --> 00:10:30.959 align:start position:0% here right above the budget so it's 00:10:30.959 --> 00:10:32.269 align:start position:0% here right above the budget so it's getting<00:10:31.140> more<00:10:31.380> and<00:10:31.560> more<00:10:31.740> sure<00:10:31.860> that<00:10:32.100> okay 00:10:32.269 --> 00:10:32.279 align:start position:0% getting more and more sure that okay 00:10:32.279 --> 00:10:34.670 align:start position:0% getting more and more sure that okay this<00:10:32.580> is<00:10:32.700> the<00:10:32.880> max<00:10:33.060> that<00:10:33.660> I<00:10:33.839> can<00:10:33.959> get<00:10:34.200> right 00:10:34.670 --> 00:10:34.680 align:start position:0% this is the max that I can get right 00:10:34.680 --> 00:10:36.769 align:start position:0% this is the max that I can get right that's<00:10:35.100> the<00:10:35.339> highest<00:10:35.700> price<00:10:35.880> that's<00:10:36.480> that's 00:10:36.769 --> 00:10:36.779 align:start position:0% that's the highest price that's that's 00:10:36.779 --> 00:10:38.690 align:start position:0% that's the highest price that's that's the<00:10:36.959> highest<00:10:37.200> bid<00:10:37.440> that<00:10:37.560> I<00:10:37.680> can<00:10:37.800> make<00:10:37.980> so<00:10:38.519> as 00:10:38.690 --> 00:10:38.700 align:start position:0% the highest bid that I can make so as 00:10:38.700 --> 00:10:40.009 align:start position:0% the highest bid that I can make so as you<00:10:38.820> can<00:10:38.880> see<00:10:38.940> the<00:10:39.060> agent<00:10:39.360> is<00:10:39.480> dropping<00:10:39.899> some 00:10:40.009 --> 00:10:40.019 align:start position:0% you can see the agent is dropping some 00:10:40.019 --> 00:10:43.070 align:start position:0% you can see the agent is dropping some of<00:10:40.140> the<00:10:40.260> queries<00:10:40.560> right<00:10:40.880> uh<00:10:41.880> what<00:10:42.300> is<00:10:42.480> revenues 00:10:43.070 --> 00:10:43.080 align:start position:0% of the queries right uh what is revenues 00:10:43.080 --> 00:10:45.230 align:start position:0% of the queries right uh what is revenues is<00:10:43.200> nicely<00:10:43.680> nicely<00:10:44.160> growing<00:10:44.519> all<00:10:44.880> right<00:10:45.060> so 00:10:45.230 --> 00:10:45.240 align:start position:0% is nicely nicely growing all right so 00:10:45.240 --> 00:10:47.090 align:start position:0% is nicely nicely growing all right so first<00:10:45.420> proper<00:10:45.779> property<00:10:46.320> test<00:10:46.500> right<00:10:46.800> that 00:10:47.090 --> 00:10:47.100 align:start position:0% first proper property test right that 00:10:47.100 --> 00:10:48.610 align:start position:0% first proper property test right that was<00:10:47.399> the<00:10:47.640> static 00:10:48.610 --> 00:10:48.620 align:start position:0% was the static 00:10:48.620 --> 00:10:50.930 align:start position:0% was the static environment<00:10:49.620> so<00:10:50.040> how<00:10:50.220> about<00:10:50.399> Dynamic 00:10:50.930 --> 00:10:50.940 align:start position:0% environment so how about Dynamic 00:10:50.940 --> 00:10:52.910 align:start position:0% environment so how about Dynamic environment<00:10:51.300> right<00:10:51.660> by<00:10:51.959> by<00:10:52.019> Dynamic<00:10:52.620> I<00:10:52.740> mean 00:10:52.910 --> 00:10:52.920 align:start position:0% environment right by by Dynamic I mean 00:10:52.920 --> 00:10:55.130 align:start position:0% environment right by by Dynamic I mean that<00:10:53.160> the<00:10:53.519> customer<00:10:53.700> budget<00:10:54.360> can<00:10:54.600> change<00:10:54.839> can 00:10:55.130 --> 00:10:55.140 align:start position:0% that the customer budget can change can 00:10:55.140 --> 00:10:57.769 align:start position:0% that the customer budget can change can vary<00:10:55.440> over<00:10:55.680> time<00:10:56.459> right<00:10:56.880> so<00:10:57.120> in<00:10:57.300> this<00:10:57.420> case<00:10:57.540> we 00:10:57.769 --> 00:10:57.779 align:start position:0% vary over time right so in this case we 00:10:57.779 --> 00:10:59.750 align:start position:0% vary over time right so in this case we are<00:10:57.959> also<00:10:58.440> testing<00:10:59.040> the<00:10:59.160> same<00:10:59.339> property 00:10:59.750 --> 00:10:59.760 align:start position:0% are also testing the same property 00:10:59.760 --> 00:11:01.430 align:start position:0% are also testing the same property whether<00:11:00.120> the<00:11:00.420> customer<00:11:00.600> budget<00:11:01.079> can<00:11:01.320> be 00:11:01.430 --> 00:11:01.440 align:start position:0% whether the customer budget can be 00:11:01.440 --> 00:11:03.710 align:start position:0% whether the customer budget can be discovered<00:11:01.800> by<00:11:01.920> the<00:11:02.040> agent<00:11:02.339> but<00:11:03.000> in<00:11:03.540> more 00:11:03.710 --> 00:11:03.720 align:start position:0% discovered by the agent but in more 00:11:03.720 --> 00:11:05.449 align:start position:0% discovered by the agent but in more difficult<00:11:04.140> market<00:11:04.380> conditions<00:11:04.980> let's<00:11:05.220> say 00:11:05.449 --> 00:11:05.459 align:start position:0% difficult market conditions let's say 00:11:05.459 --> 00:11:07.610 align:start position:0% difficult market conditions let's say right<00:11:06.060> so<00:11:06.360> once<00:11:06.720> again<00:11:06.779> we<00:11:07.200> are<00:11:07.380> starting 00:11:07.610 --> 00:11:07.620 align:start position:0% right so once again we are starting 00:11:07.620 --> 00:11:10.069 align:start position:0% right so once again we are starting agent<00:11:08.519> is<00:11:08.700> kind<00:11:08.880> of<00:11:09.000> a<00:11:09.120> converging<00:11:09.600> capturing 00:11:10.069 --> 00:11:10.079 align:start position:0% agent is kind of a converging capturing 00:11:10.079 --> 00:11:13.550 align:start position:0% agent is kind of a converging capturing the<00:11:10.260> the<00:11:10.500> right<00:11:11.220> the<00:11:11.700> price<00:11:12.120> right<00:11:12.600> which<00:11:13.440> is 00:11:13.550 --> 00:11:13.560 align:start position:0% the the right the price right which is 00:11:13.560 --> 00:11:14.930 align:start position:0% the the right the price right which is kind<00:11:13.680> of<00:11:13.800> optimal<00:11:14.339> and<00:11:14.519> then<00:11:14.640> the<00:11:14.820> price 00:11:14.930 --> 00:11:14.940 align:start position:0% kind of optimal and then the price 00:11:14.940 --> 00:11:17.269 align:start position:0% kind of optimal and then the price changes<00:11:15.360> so<00:11:15.540> what<00:11:15.660> happens<00:11:15.839> is<00:11:16.079> the<00:11:16.260> agent<00:11:16.620> is 00:11:17.269 --> 00:11:17.279 align:start position:0% changes so what happens is the agent is 00:11:17.279 --> 00:11:19.970 align:start position:0% changes so what happens is the agent is is<00:11:17.480> not<00:11:18.480> getting<00:11:18.660> getting<00:11:19.019> any<00:11:19.320> queries<00:11:19.740> right 00:11:19.970 --> 00:11:19.980 align:start position:0% is not getting getting any queries right 00:11:19.980 --> 00:11:21.590 align:start position:0% is not getting getting any queries right so<00:11:20.399> it's<00:11:20.579> saying<00:11:20.820> okay<00:11:20.940> I<00:11:21.240> don't<00:11:21.300> know<00:11:21.420> where 00:11:21.590 --> 00:11:21.600 align:start position:0% so it's saying okay I don't know where 00:11:21.600 --> 00:11:24.350 align:start position:0% so it's saying okay I don't know where am<00:11:21.720> I<00:11:21.839> so<00:11:22.079> it's<00:11:22.380> press<00:11:22.620> the<00:11:22.860> gaussian<00:11:23.279> and<00:11:23.880> once 00:11:24.350 --> 00:11:24.360 align:start position:0% am I so it's press the gaussian and once 00:11:24.360 --> 00:11:26.569 align:start position:0% am I so it's press the gaussian and once the<00:11:24.600> queries<00:11:24.899> are<00:11:25.079> once<00:11:25.320> again<00:11:25.380> captured<00:11:25.980> it 00:11:26.569 --> 00:11:26.579 align:start position:0% the queries are once again captured it 00:11:26.579 --> 00:11:28.250 align:start position:0% the queries are once again captured it it<00:11:26.700> moves<00:11:27.000> to<00:11:27.120> the<00:11:27.240> left<00:11:27.360> right<00:11:27.660> so<00:11:27.959> it's<00:11:28.079> like 00:11:28.250 --> 00:11:28.260 align:start position:0% it moves to the left right so it's like 00:11:28.260 --> 00:11:30.170 align:start position:0% it moves to the left right so it's like okay<00:11:28.440> I<00:11:28.680> was<00:11:28.860> above<00:11:29.100> the<00:11:29.279> budget<00:11:29.579> let<00:11:29.820> me<00:11:30.000> let 00:11:30.170 --> 00:11:30.180 align:start position:0% okay I was above the budget let me let 00:11:30.180 --> 00:11:32.750 align:start position:0% okay I was above the budget let me let me<00:11:30.420> go<00:11:30.720> back<00:11:30.899> right<00:11:31.380> and<00:11:31.620> that<00:11:31.860> happens<00:11:32.100> that 00:11:32.750 --> 00:11:32.760 align:start position:0% me go back right and that happens that 00:11:32.760 --> 00:11:34.610 align:start position:0% me go back right and that happens that is<00:11:32.880> happening<00:11:33.180> over<00:11:33.360> time<00:11:33.660> right<00:11:33.959> so<00:11:34.440> there 00:11:34.610 --> 00:11:34.620 align:start position:0% is happening over time right so there 00:11:34.620 --> 00:11:36.530 align:start position:0% is happening over time right so there are<00:11:34.740> plenty<00:11:34.920> of<00:11:34.980> queries<00:11:35.459> queries<00:11:36.060> dropped 00:11:36.530 --> 00:11:36.540 align:start position:0% are plenty of queries queries dropped 00:11:36.540 --> 00:11:38.870 align:start position:0% are plenty of queries queries dropped but<00:11:37.019> still<00:11:37.260> we<00:11:37.740> are<00:11:37.920> we<00:11:38.100> are<00:11:38.339> making<00:11:38.459> some<00:11:38.760> nice 00:11:38.870 --> 00:11:38.880 align:start position:0% but still we are we are making some nice 00:11:38.880 --> 00:11:40.730 align:start position:0% but still we are we are making some nice Revenue<00:11:39.240> right<00:11:39.480> and<00:11:39.720> we<00:11:39.899> are<00:11:40.019> reacting<00:11:40.380> to<00:11:40.500> the 00:11:40.730 --> 00:11:40.740 align:start position:0% Revenue right and we are reacting to the 00:11:40.740 --> 00:11:43.250 align:start position:0% Revenue right and we are reacting to the to<00:11:40.980> the<00:11:41.220> dynamic<00:11:41.640> dynamic<00:11:42.300> Market 00:11:43.250 --> 00:11:43.260 align:start position:0% to the dynamic dynamic Market 00:11:43.260 --> 00:11:46.009 align:start position:0% to the dynamic dynamic Market cool<00:11:43.920> second<00:11:44.399> property<00:11:44.880> check 00:11:46.009 --> 00:11:46.019 align:start position:0% cool second property check 00:11:46.019 --> 00:11:49.790 align:start position:0% cool second property check so<00:11:46.620> in<00:11:47.160> further<00:11:47.519> experiment<00:11:47.880> we<00:11:48.240> said<00:11:48.420> okay<00:11:49.140> so 00:11:49.790 --> 00:11:49.800 align:start position:0% so in further experiment we said okay so 00:11:49.800 --> 00:11:51.470 align:start position:0% so in further experiment we said okay so there<00:11:50.040> are<00:11:50.160> some<00:11:50.220> subgraphs<00:11:50.880> that<00:11:51.300> actually 00:11:51.470 --> 00:11:51.480 align:start position:0% there are some subgraphs that actually 00:11:51.480 --> 00:11:52.970 align:start position:0% there are some subgraphs that actually you<00:11:51.720> have<00:11:51.839> no<00:11:51.959> queries<00:11:52.260> at<00:11:52.440> all<00:11:52.560> right<00:11:52.800> there 00:11:52.970 --> 00:11:52.980 align:start position:0% you have no queries at all right there 00:11:52.980 --> 00:11:55.730 align:start position:0% you have no queries at all right there is<00:11:53.160> a<00:11:53.220> moment<00:11:53.459> where<00:11:53.760> nobody's<00:11:54.600> is<00:11:55.260> asking<00:11:55.620> for 00:11:55.730 --> 00:11:55.740 align:start position:0% is a moment where nobody's is asking for 00:11:55.740 --> 00:11:58.250 align:start position:0% is a moment where nobody's is asking for queries<00:11:56.160> so<00:11:56.399> what<00:11:56.940> will<00:11:57.120> happen<00:11:57.300> then 00:11:58.250 --> 00:11:58.260 align:start position:0% queries so what will happen then 00:11:58.260 --> 00:12:00.410 align:start position:0% queries so what will happen then so<00:11:58.500> that's<00:11:58.740> a<00:11:58.920> different<00:11:59.100> scenario<00:11:59.640> in<00:12:00.300> this 00:12:00.410 --> 00:12:00.420 align:start position:0% so that's a different scenario in this 00:12:00.420 --> 00:12:02.210 align:start position:0% so that's a different scenario in this case<00:12:00.540> we<00:12:00.839> call<00:12:01.019> that<00:12:01.200> the<00:12:01.380> marking<00:12:01.740> conditions 00:12:02.210 --> 00:12:02.220 align:start position:0% case we call that the marking conditions 00:12:02.220 --> 00:12:03.710 align:start position:0% case we call that the marking conditions basically<00:12:02.640> there<00:12:02.820> is<00:12:02.940> no<00:12:03.060> demand<00:12:03.360> for<00:12:03.540> your 00:12:03.710 --> 00:12:03.720 align:start position:0% basically there is no demand for your 00:12:03.720 --> 00:12:05.930 align:start position:0% basically there is no demand for your services<00:12:03.959> right<00:12:04.440> so<00:12:04.800> we<00:12:05.100> wonder<00:12:05.279> how<00:12:05.760> we 00:12:05.930 --> 00:12:05.940 align:start position:0% services right so we wonder how we 00:12:05.940 --> 00:12:06.949 align:start position:0% services right so we wonder how we should<00:12:06.060> add 00:12:06.949 --> 00:12:06.959 align:start position:0% should add 00:12:06.959 --> 00:12:08.449 align:start position:0% should add so 00:12:08.449 --> 00:12:08.459 align:start position:0% so 00:12:08.459 --> 00:12:10.069 align:start position:0% so it<00:12:08.880> will<00:12:09.000> happen<00:12:09.180> in<00:12:09.420> a<00:12:09.540> second<00:12:09.720> right<00:12:09.899> so 00:12:10.069 --> 00:12:10.079 align:start position:0% it will happen in a second right so 00:12:10.079 --> 00:12:11.210 align:start position:0% it will happen in a second right so there<00:12:10.320> will<00:12:10.440> be<00:12:10.560> like<00:12:10.680> three<00:12:10.860> iterations 00:12:11.210 --> 00:12:11.220 align:start position:0% there will be like three iterations 00:12:11.220 --> 00:12:12.590 align:start position:0% there will be like three iterations we're<00:12:11.519> recording<00:12:11.880> few<00:12:12.120> of<00:12:12.240> those<00:12:12.360> those 00:12:12.590 --> 00:12:12.600 align:start position:0% we're recording few of those those 00:12:12.600 --> 00:12:14.150 align:start position:0% we're recording few of those those videos<00:12:12.839> but<00:12:13.200> as<00:12:13.320> you<00:12:13.500> can<00:12:13.620> see<00:12:13.740> already 00:12:14.150 --> 00:12:14.160 align:start position:0% videos but as you can see already 00:12:14.160 --> 00:12:16.550 align:start position:0% videos but as you can see already there's<00:12:14.579> a<00:12:14.760> hint<00:12:15.000> in<00:12:15.420> the<00:12:15.600> right<00:12:15.839> hand<00:12:16.140> corner 00:12:16.550 --> 00:12:16.560 align:start position:0% there's a hint in the right hand corner 00:12:16.560 --> 00:12:18.350 align:start position:0% there's a hint in the right hand corner that<00:12:16.680> something<00:12:16.860> is<00:12:17.220> not<00:12:17.399> right<00:12:17.579> all<00:12:18.180> right 00:12:18.350 --> 00:12:18.360 align:start position:0% that something is not right all right 00:12:18.360 --> 00:12:20.630 align:start position:0% that something is not right all right gaussian<00:12:19.140> spread<00:12:19.440> this<00:12:19.620> is<00:12:19.740> great<00:12:19.920> and<00:12:20.399> now 00:12:20.630 --> 00:12:20.640 align:start position:0% gaussian spread this is great and now 00:12:20.640 --> 00:12:23.449 align:start position:0% gaussian spread this is great and now time<00:12:21.120> set<00:12:21.300> 400<00:12:21.779> because<00:12:22.079> every<00:12:22.380> 200<00:12:22.860> steps 00:12:23.449 --> 00:12:23.459 align:start position:0% time set 400 because every 200 steps 00:12:23.459 --> 00:12:25.850 align:start position:0% time set 400 because every 200 steps were<00:12:23.640> like<00:12:23.880> you<00:12:24.120> know<00:12:24.240> to<00:12:24.899> write<00:12:25.079> it<00:12:25.260> okay<00:12:25.560> so 00:12:25.850 --> 00:12:25.860 align:start position:0% were like you know to write it okay so 00:12:25.860 --> 00:12:28.130 align:start position:0% were like you know to write it okay so what<00:12:26.100> just<00:12:26.279> happened<00:12:27.000> there<00:12:27.540> are<00:12:27.660> no<00:12:27.779> queries 00:12:28.130 --> 00:12:28.140 align:start position:0% what just happened there are no queries 00:12:28.140 --> 00:12:29.930 align:start position:0% what just happened there are no queries so<00:12:28.320> according<00:12:28.740> to<00:12:28.860> the<00:12:29.100> design<00:12:29.339> the<00:12:29.640> agent 00:12:29.930 --> 00:12:29.940 align:start position:0% so according to the design the agent 00:12:29.940 --> 00:12:32.030 align:start position:0% so according to the design the agent just<00:12:30.060> said<00:12:30.240> okay<00:12:30.420> let<00:12:30.779> me<00:12:30.959> spread<00:12:31.320> right<00:12:31.620> so<00:12:31.860> I 00:12:32.030 --> 00:12:32.040 align:start position:0% just said okay let me spread right so I 00:12:32.040 --> 00:12:34.490 align:start position:0% just said okay let me spread right so I can<00:12:32.160> sample<00:12:32.459> from<00:12:32.640> wider<00:12:33.360> distribution<00:12:33.720> but 00:12:34.490 --> 00:12:34.500 align:start position:0% can sample from wider distribution but 00:12:34.500 --> 00:12:36.530 align:start position:0% can sample from wider distribution but actually<00:12:34.740> spread<00:12:35.279> all<00:12:35.459> across<00:12:35.940> the<00:12:36.120> the<00:12:36.420> the 00:12:36.530 --> 00:12:36.540 align:start position:0% actually spread all across the the the 00:12:36.540 --> 00:12:39.710 align:start position:0% actually spread all across the the the the<00:12:36.720> price<00:12:37.380> Biz<00:12:37.680> domain<00:12:38.040> so<00:12:38.880> we<00:12:39.360> said<00:12:39.480> okay 00:12:39.710 --> 00:12:39.720 align:start position:0% the price Biz domain so we said okay 00:12:39.720 --> 00:12:41.449 align:start position:0% the price Biz domain so we said okay actually<00:12:40.079> this<00:12:40.500> is<00:12:40.620> not<00:12:40.740> a<00:12:40.920> good<00:12:41.040> behavior 00:12:41.449 --> 00:12:41.459 align:start position:0% actually this is not a good behavior 00:12:41.459 --> 00:12:44.629 align:start position:0% actually this is not a good behavior right<00:12:41.700> we<00:12:42.060> if<00:12:43.019> this<00:12:43.500> is<00:12:43.620> happening<00:12:43.980> then<00:12:44.339> the 00:12:44.629 --> 00:12:44.639 align:start position:0% right we if this is happening then the 00:12:44.639 --> 00:12:46.790 align:start position:0% right we if this is happening then the agent<00:12:45.000> can<00:12:45.180> can<00:12:45.480> sample<00:12:46.019> at<00:12:46.260> the<00:12:46.680> same 00:12:46.790 --> 00:12:46.800 align:start position:0% agent can can sample at the same 00:12:46.800 --> 00:12:48.889 align:start position:0% agent can can sample at the same probability<00:12:47.220> like<00:12:47.700> super<00:12:47.940> some<00:12:48.300> super<00:12:48.600> small 00:12:48.889 --> 00:12:48.899 align:start position:0% probability like super some super small 00:12:48.899 --> 00:12:51.590 align:start position:0% probability like super some super small prices<00:12:49.500> price<00:12:49.980> bits<00:12:50.459> and<00:12:50.700> at<00:12:50.940> the<00:12:51.060> same<00:12:51.180> super 00:12:51.590 --> 00:12:51.600 align:start position:0% prices price bits and at the same super 00:12:51.600 --> 00:12:53.509 align:start position:0% prices price bits and at the same super high<00:12:51.899> moreover<00:12:52.500> recovery<00:12:53.040> from<00:12:53.160> that<00:12:53.339> will 00:12:53.509 --> 00:12:53.519 align:start position:0% high moreover recovery from that will 00:12:53.519 --> 00:12:56.090 align:start position:0% high moreover recovery from that will take<00:12:53.700> a<00:12:53.820> lot<00:12:53.940> of<00:12:54.060> time<00:12:54.240> so<00:12:55.019> we<00:12:55.139> said<00:12:55.320> okay<00:12:55.500> can 00:12:56.090 --> 00:12:56.100 align:start position:0% take a lot of time so we said okay can 00:12:56.100 --> 00:12:58.069 align:start position:0% take a lot of time so we said okay can we<00:12:56.279> improve<00:12:56.579> that<00:12:56.760> so<00:12:57.480> we<00:12:57.600> implemented 00:12:58.069 --> 00:12:58.079 align:start position:0% we improve that so we implemented 00:12:58.079 --> 00:12:59.569 align:start position:0% we improve that so we implemented something<00:12:58.260> that<00:12:58.560> we<00:12:58.680> called<00:12:58.860> graceful 00:12:59.569 --> 00:12:59.579 align:start position:0% something that we called graceful 00:12:59.579 --> 00:13:02.110 align:start position:0% something that we called graceful initial<00:13:00.060> pull<00:13:00.420> which<00:13:01.079> basically 00:13:02.110 --> 00:13:02.120 align:start position:0% initial pull which basically 00:13:02.120 --> 00:13:04.730 align:start position:0% initial pull which basically uh<00:13:03.120> the<00:13:03.540> idea<00:13:03.839> is<00:13:03.899> that<00:13:04.079> okay<00:13:04.260> there's<00:13:04.560> this 00:13:04.730 --> 00:13:04.740 align:start position:0% uh the idea is that okay there's this 00:13:04.740 --> 00:13:06.470 align:start position:0% uh the idea is that okay there's this initial<00:13:05.100> distribution<00:13:05.579> that<00:13:05.940> the<00:13:06.120> agency<00:13:06.420> is 00:13:06.470 --> 00:13:06.480 align:start position:0% initial distribution that the agency is 00:13:06.480 --> 00:13:07.790 align:start position:0% initial distribution that the agency is starting<00:13:06.720> from<00:13:06.899> this<00:13:07.079> is<00:13:07.200> something<00:13:07.320> that<00:13:07.620> the 00:13:07.790 --> 00:13:07.800 align:start position:0% starting from this is something that the 00:13:07.800 --> 00:13:09.590 align:start position:0% starting from this is something that the index<00:13:08.220> service<00:13:08.459> will<00:13:08.820> parameterize<00:13:09.420> the 00:13:09.590 --> 00:13:09.600 align:start position:0% index service will parameterize the 00:13:09.600 --> 00:13:11.870 align:start position:0% index service will parameterize the agent<00:13:09.839> when<00:13:10.019> when<00:13:10.320> when<00:13:10.740> the<00:13:11.459> agent<00:13:11.700> is 00:13:11.870 --> 00:13:11.880 align:start position:0% agent when when when the agent is 00:13:11.880 --> 00:13:13.670 align:start position:0% agent when when when the agent is deployed<00:13:12.240> and<00:13:12.839> where<00:13:13.019> when<00:13:13.260> there<00:13:13.440> are<00:13:13.560> no 00:13:13.670 --> 00:13:13.680 align:start position:0% deployed and where when there are no 00:13:13.680 --> 00:13:16.069 align:start position:0% deployed and where when there are no queries<00:13:14.040> it<00:13:14.459> just<00:13:14.760> slowly<00:13:15.240> is<00:13:15.420> pulled<00:13:15.779> towards 00:13:16.069 --> 00:13:16.079 align:start position:0% queries it just slowly is pulled towards 00:13:16.079 --> 00:13:17.690 align:start position:0% queries it just slowly is pulled towards that<00:13:16.200> initial<00:13:16.500> distribution<00:13:16.920> right<00:13:17.220> and<00:13:17.519> when 00:13:17.690 --> 00:13:17.700 align:start position:0% that initial distribution right and when 00:13:17.700 --> 00:13:19.670 align:start position:0% that initial distribution right and when the<00:13:17.820> queries<00:13:18.180> will<00:13:18.420> appear<00:13:18.660> once<00:13:18.959> again<00:13:19.019> it 00:13:19.670 --> 00:13:19.680 align:start position:0% the queries will appear once again it 00:13:19.680 --> 00:13:21.530 align:start position:0% the queries will appear once again it will<00:13:19.800> get<00:13:19.980> from<00:13:20.160> there<00:13:20.339> and<00:13:20.639> once<00:13:20.940> again<00:13:21.000> start 00:13:21.530 --> 00:13:21.540 align:start position:0% will get from there and once again start 00:13:21.540 --> 00:13:23.990 align:start position:0% will get from there and once again start there's<00:13:21.959> something 00:13:23.990 --> 00:13:24.000 align:start position:0% there's something 00:13:24.000 --> 00:13:26.810 align:start position:0% there's something I'm<00:13:24.420> losing<00:13:25.019> from<00:13:25.260> time<00:13:25.380> to<00:13:25.560> time 00:13:26.810 --> 00:13:26.820 align:start position:0% I'm losing from time to time 00:13:26.820 --> 00:13:28.730 align:start position:0% I'm losing from time to time the<00:13:27.180> voice<00:13:27.480> I<00:13:27.779> think 00:13:28.730 --> 00:13:28.740 align:start position:0% the voice I think 00:13:28.740 --> 00:13:29.509 align:start position:0% the voice I think um 00:13:29.509 --> 00:13:29.519 align:start position:0% um 00:13:29.519 --> 00:13:33.470 align:start position:0% um Okay<00:13:30.120> cool<00:13:30.899> so<00:13:31.200> we<00:13:31.440> pass<00:13:31.680> the<00:13:31.920> property<00:13:32.820> so<00:13:33.360> now 00:13:33.470 --> 00:13:33.480 align:start position:0% Okay cool so we pass the property so now 00:13:33.480 --> 00:13:35.090 align:start position:0% Okay cool so we pass the property so now let's<00:13:33.660> move<00:13:33.839> into<00:13:33.959> multi-aging<00:13:34.740> simulation 00:13:35.090 --> 00:13:35.100 align:start position:0% let's move into multi-aging simulation 00:13:35.100 --> 00:13:37.009 align:start position:0% let's move into multi-aging simulation so<00:13:35.519> this<00:13:35.760> was<00:13:35.940> great<00:13:36.120> at<00:13:36.420> that<00:13:36.540> point<00:13:36.720> you<00:13:36.899> know 00:13:37.009 --> 00:13:37.019 align:start position:0% so this was great at that point you know 00:13:37.019 --> 00:13:38.569 align:start position:0% so this was great at that point you know we<00:13:37.260> aren't<00:13:37.500> we<00:13:37.740> aren't<00:13:37.980> competing<00:13:38.399> with 00:13:38.569 --> 00:13:38.579 align:start position:0% we aren't we aren't competing with 00:13:38.579 --> 00:13:41.150 align:start position:0% we aren't we aren't competing with anyone<00:13:39.180> up<00:13:39.600> till<00:13:39.779> that<00:13:39.959> moment<00:13:40.200> right<00:13:40.440> now<00:13:40.980> we 00:13:41.150 --> 00:13:41.160 align:start position:0% anyone up till that moment right now we 00:13:41.160 --> 00:13:43.190 align:start position:0% anyone up till that moment right now we are<00:13:41.339> starting<00:13:41.519> with<00:13:42.000> with<00:13:42.540> some<00:13:42.839> we're 00:13:43.190 --> 00:13:43.200 align:start position:0% are starting with with some we're 00:13:43.200 --> 00:13:44.810 align:start position:0% are starting with with some we're competing<00:13:43.560> with<00:13:43.740> some<00:13:43.860> deterministic<00:13:44.459> agents 00:13:44.810 --> 00:13:44.820 align:start position:0% competing with some deterministic agents 00:13:44.820 --> 00:13:46.850 align:start position:0% competing with some deterministic agents the<00:13:45.000> idea<00:13:45.300> is<00:13:45.480> that 00:13:46.850 --> 00:13:46.860 align:start position:0% the idea is that 00:13:46.860 --> 00:13:49.790 align:start position:0% the idea is that right<00:13:47.399> now<00:13:47.519> all<00:13:48.180> the<00:13:48.360> all<00:13:48.899> the<00:13:49.079> indexers<00:13:49.500> have 00:13:49.790 --> 00:13:49.800 align:start position:0% right now all the all the indexers have 00:13:49.800 --> 00:13:52.550 align:start position:0% right now all the all the indexers have that<00:13:50.040> the<00:13:50.279> Agra<00:13:50.760> models<00:13:51.180> that<00:13:51.360> is<00:13:51.480> fixed<00:13:52.320> right 00:13:52.550 --> 00:13:52.560 align:start position:0% that the Agra models that is fixed right 00:13:52.560 --> 00:13:54.170 align:start position:0% that the Agra models that is fixed right they<00:13:52.860> are<00:13:53.040> not<00:13:53.100> changing<00:13:53.399> the<00:13:53.519> models<00:13:53.880> so<00:13:54.060> it 00:13:54.170 --> 00:13:54.180 align:start position:0% they are not changing the models so it 00:13:54.180 --> 00:13:56.150 align:start position:0% they are not changing the models so it can<00:13:54.300> be<00:13:54.480> seen<00:13:54.959> as<00:13:55.139> a<00:13:55.260> rule<00:13:55.500> base<00:13:55.680> right<00:13:55.980> so 00:13:56.150 --> 00:13:56.160 align:start position:0% can be seen as a rule base right so 00:13:56.160 --> 00:13:58.009 align:start position:0% can be seen as a rule base right so there's<00:13:56.279> like<00:13:56.519> okay<00:13:56.880> that's<00:13:57.120> my<00:13:57.360> bid<00:13:57.660> and<00:13:57.899> I'm 00:13:58.009 --> 00:13:58.019 align:start position:0% there's like okay that's my bid and I'm 00:13:58.019 --> 00:14:00.230 align:start position:0% there's like okay that's my bid and I'm sticking<00:13:58.380> with<00:13:58.500> it<00:13:58.680> no<00:13:58.800> matter<00:13:58.980> what<00:13:59.579> right<00:14:00.120> so 00:14:00.230 --> 00:14:00.240 align:start position:0% sticking with it no matter what right so 00:14:00.240 --> 00:14:02.329 align:start position:0% sticking with it no matter what right so this<00:14:00.480> is<00:14:00.540> what<00:14:00.779> we<00:14:00.959> are<00:14:01.139> trying<00:14:01.620> to<00:14:01.800> model<00:14:01.920> here 00:14:02.329 --> 00:14:02.339 align:start position:0% this is what we are trying to model here 00:14:02.339 --> 00:14:04.129 align:start position:0% this is what we are trying to model here competition<00:14:02.820> with<00:14:03.000> deterministic<00:14:03.720> agents 00:14:04.129 --> 00:14:04.139 align:start position:0% competition with deterministic agents 00:14:04.139 --> 00:14:06.410 align:start position:0% competition with deterministic agents and<00:14:04.920> the<00:14:05.160> property<00:14:05.459> that<00:14:05.700> we<00:14:05.880> are<00:14:06.000> testing<00:14:06.300> is 00:14:06.410 --> 00:14:06.420 align:start position:0% and the property that we are testing is 00:14:06.420 --> 00:14:07.190 align:start position:0% and the property that we are testing is called 00:14:07.190 --> 00:14:07.200 align:start position:0% called 00:14:07.200 --> 00:14:09.290 align:start position:0% called discover<00:14:07.560> of<00:14:07.980> prized<00:14:08.399> bits<00:14:08.700> of<00:14:08.760> competitive 00:14:09.290 --> 00:14:09.300 align:start position:0% discover of prized bits of competitive 00:14:09.300 --> 00:14:10.730 align:start position:0% discover of prized bits of competitive agents<00:14:09.779> right<00:14:09.899> so<00:14:10.079> we<00:14:10.260> want<00:14:10.380> to<00:14:10.500> make<00:14:10.620> sure 00:14:10.730 --> 00:14:10.740 align:start position:0% agents right so we want to make sure 00:14:10.740 --> 00:14:14.750 align:start position:0% agents right so we want to make sure that<00:14:10.980> we<00:14:11.220> we<00:14:11.760> also<00:14:12.120> will<00:14:12.360> uh<00:14:13.079> we<00:14:13.920> can<00:14:14.040> let's<00:14:14.579> say 00:14:14.750 --> 00:14:14.760 align:start position:0% that we we also will uh we can let's say 00:14:14.760 --> 00:14:16.490 align:start position:0% that we we also will uh we can let's say compete<00:14:15.120> with<00:14:15.240> them<00:14:15.420> and<00:14:15.660> discover<00:14:15.839> what<00:14:16.320> are 00:14:16.490 --> 00:14:16.500 align:start position:0% compete with them and discover what are 00:14:16.500 --> 00:14:18.050 align:start position:0% compete with them and discover what are what<00:14:16.800> were<00:14:16.920> their<00:14:17.100> bits<00:14:17.519> without<00:14:17.700> actually 00:14:18.050 --> 00:14:18.060 align:start position:0% what were their bits without actually 00:14:18.060 --> 00:14:19.730 align:start position:0% what were their bits without actually knowing<00:14:18.540> them<00:14:18.720> without<00:14:18.959> having<00:14:19.500> That 00:14:19.730 --> 00:14:19.740 align:start position:0% knowing them without having That 00:14:19.740 --> 00:14:21.829 align:start position:0% knowing them without having That explicit<00:14:20.279> information<00:14:20.459> so<00:14:21.420> those<00:14:21.600> three 00:14:21.829 --> 00:14:21.839 align:start position:0% explicit information so those three 00:14:21.839 --> 00:14:23.389 align:start position:0% explicit information so those three lines<00:14:22.139> in<00:14:22.380> here 00:14:23.389 --> 00:14:23.399 align:start position:0% lines in here 00:14:23.399 --> 00:14:26.030 align:start position:0% lines in here actually<00:14:23.880> those<00:14:24.660> are<00:14:24.899> the<00:14:25.019> three<00:14:25.320> three 00:14:26.030 --> 00:14:26.040 align:start position:0% actually those are the three three 00:14:26.040 --> 00:14:27.769 align:start position:0% actually those are the three three competitive<00:14:26.579> agents<00:14:27.000> with<00:14:27.180> deterministic 00:14:27.769 --> 00:14:27.779 align:start position:0% competitive agents with deterministic 00:14:27.779 --> 00:14:30.769 align:start position:0% competitive agents with deterministic policies<00:14:28.200> that<00:14:28.500> they're<00:14:28.800> just<00:14:29.399> set<00:14:29.880> and<00:14:30.600> the 00:14:30.769 --> 00:14:30.779 align:start position:0% policies that they're just set and the 00:14:30.779 --> 00:14:33.710 align:start position:0% policies that they're just set and the blue<00:14:30.959> agent<00:14:31.380> in<00:14:31.800> this<00:14:31.860> case<00:14:32.060> is<00:14:33.060> the<00:14:33.360> one<00:14:33.480> is 00:14:33.710 --> 00:14:33.720 align:start position:0% blue agent in this case is the one is 00:14:33.720 --> 00:14:36.590 align:start position:0% blue agent in this case is the one is the<00:14:34.079> Bandit<00:14:34.500> right<00:14:34.860> and<00:14:35.579> as<00:14:35.700> you<00:14:35.880> can<00:14:36.000> see<00:14:36.120> it 00:14:36.590 --> 00:14:36.600 align:start position:0% the Bandit right and as you can see it 00:14:36.600 --> 00:14:39.050 align:start position:0% the Bandit right and as you can see it after<00:14:37.200> a<00:14:37.500> while<00:14:37.620> it's<00:14:37.980> set<00:14:38.160> up<00:14:38.279> like<00:14:38.519> a<00:14:38.820> price 00:14:39.050 --> 00:14:39.060 align:start position:0% after a while it's set up like a price 00:14:39.060 --> 00:14:41.750 align:start position:0% after a while it's set up like a price just<00:14:39.600> below<00:14:40.079> the<00:14:40.380> the<00:14:40.680> the<00:14:40.800> the<00:14:41.160> cheapest 00:14:41.750 --> 00:14:41.760 align:start position:0% just below the the the the cheapest 00:14:41.760 --> 00:14:43.550 align:start position:0% just below the the the the cheapest agents<00:14:42.180> which<00:14:42.300> means<00:14:42.540> that<00:14:42.720> it's<00:14:43.199> trying<00:14:43.440> to 00:14:43.550 --> 00:14:43.560 align:start position:0% agents which means that it's trying to 00:14:43.560 --> 00:14:45.650 align:start position:0% agents which means that it's trying to once<00:14:43.920> again<00:14:43.980> snatch<00:14:44.579> the<00:14:45.060> whole<00:14:45.180> Market<00:14:45.360> if 00:14:45.650 --> 00:14:45.660 align:start position:0% once again snatch the whole Market if 00:14:45.660 --> 00:14:47.449 align:start position:0% once again snatch the whole Market if you<00:14:45.779> will<00:14:45.959> see<00:14:46.139> a<00:14:46.500> number<00:14:46.680> of<00:14:46.800> total<00:14:47.160> queries 00:14:47.449 --> 00:14:47.459 align:start position:0% you will see a number of total queries 00:14:47.459 --> 00:14:48.949 align:start position:0% you will see a number of total queries right<00:14:47.639> you<00:14:47.940> can<00:14:48.060> see<00:14:48.180> clearly<00:14:48.600> see<00:14:48.779> a 00:14:48.949 --> 00:14:48.959 align:start position:0% right you can see clearly see a 00:14:48.959 --> 00:14:50.449 align:start position:0% right you can see clearly see a difference<00:14:49.139> right<00:14:49.500> that<00:14:49.980> agent<00:14:50.339> is 00:14:50.449 --> 00:14:50.459 align:start position:0% difference right that agent is 00:14:50.459 --> 00:14:52.910 align:start position:0% difference right that agent is dominating<00:14:51.000> right<00:14:51.360> so<00:14:51.660> I'll<00:14:52.079> say<00:14:52.320> okay<00:14:52.500> this 00:14:52.910 --> 00:14:52.920 align:start position:0% dominating right so I'll say okay this 00:14:52.920 --> 00:14:54.829 align:start position:0% dominating right so I'll say okay this is<00:14:53.040> nice<00:14:53.220> check 00:14:54.829 --> 00:14:54.839 align:start position:0% is nice check 00:14:54.839 --> 00:14:58.490 align:start position:0% is nice check cool<00:14:55.560> so<00:14:56.160> how<00:14:56.519> about<00:14:56.760> stochastic<00:14:57.500> similar 00:14:58.490 --> 00:14:58.500 align:start position:0% cool so how about stochastic similar 00:14:58.500 --> 00:15:00.710 align:start position:0% cool so how about stochastic similar experiments<00:14:59.040> we<00:14:59.459> also<00:14:59.820> want<00:14:59.940> to<00:15:00.060> discover<00:15:00.240> the 00:15:00.710 --> 00:15:00.720 align:start position:0% experiments we also want to discover the 00:15:00.720 --> 00:15:02.810 align:start position:0% experiments we also want to discover the the<00:15:01.079> price<00:15:01.740> bits<00:15:02.040> of<00:15:02.100> other<00:15:02.220> regions<00:15:02.639> but 00:15:02.810 --> 00:15:02.820 align:start position:0% the price bits of other regions but 00:15:02.820 --> 00:15:05.269 align:start position:0% the price bits of other regions but their<00:15:03.060> policies<00:15:03.480> are<00:15:03.600> stochastic<00:15:04.019> so<00:15:04.800> we 00:15:05.269 --> 00:15:05.279 align:start position:0% their policies are stochastic so we 00:15:05.279 --> 00:15:06.949 align:start position:0% their policies are stochastic so we model<00:15:05.519> them<00:15:05.880> in<00:15:06.060> the<00:15:06.240> singular<00:15:06.480> way<00:15:06.720> as 00:15:06.949 --> 00:15:06.959 align:start position:0% model them in the singular way as 00:15:06.959 --> 00:15:08.750 align:start position:0% model them in the singular way as gaussians<00:15:07.560> those<00:15:07.860> gaussian<00:15:08.279> distributions 00:15:08.750 --> 00:15:08.760 align:start position:0% gaussians those gaussian distributions 00:15:08.760 --> 00:15:11.870 align:start position:0% gaussians those gaussian distributions right<00:15:09.000> but<00:15:09.300> they<00:15:09.839> do<00:15:10.079> not<00:15:10.260> change<00:15:10.980> right 00:15:11.870 --> 00:15:11.880 align:start position:0% right but they do not change right 00:15:11.880 --> 00:15:14.210 align:start position:0% right but they do not change right so<00:15:12.420> we<00:15:12.660> observe<00:15:13.079> similar<00:15:13.380> Behavior<00:15:13.860> this<00:15:14.100> is 00:15:14.210 --> 00:15:14.220 align:start position:0% so we observe similar Behavior this is 00:15:14.220 --> 00:15:16.370 align:start position:0% so we observe similar Behavior this is great<00:15:14.399> right<00:15:14.639> so<00:15:14.880> the<00:15:15.060> agent<00:15:15.360> our<00:15:15.839> agent<00:15:16.199> right 00:15:16.370 --> 00:15:16.380 align:start position:0% great right so the agent our agent right 00:15:16.380 --> 00:15:17.990 align:start position:0% great right so the agent our agent right our<00:15:16.620> band<00:15:16.860> it<00:15:17.100> moves<00:15:17.279> somewhere<00:15:17.579> in<00:15:17.699> here<00:15:17.820> and 00:15:17.990 --> 00:15:18.000 align:start position:0% our band it moves somewhere in here and 00:15:18.000 --> 00:15:20.269 align:start position:0% our band it moves somewhere in here and of<00:15:18.180> course<00:15:18.300> it's<00:15:18.480> sampling<00:15:18.959> you<00:15:19.560> know<00:15:19.680> that 00:15:20.269 --> 00:15:20.279 align:start position:0% of course it's sampling you know that 00:15:20.279 --> 00:15:22.850 align:start position:0% of course it's sampling you know that the<00:15:20.519> red<00:15:20.639> the<00:15:21.000> red<00:15:21.180> the<00:15:21.420> red<00:15:21.600> agent<00:15:22.079> uh 00:15:22.850 --> 00:15:22.860 align:start position:0% the red the red the red agent uh 00:15:22.860 --> 00:15:25.490 align:start position:0% the red the red the red agent uh stochastic<00:15:23.720> heuristic<00:15:24.720> agent<00:15:25.019> is<00:15:25.199> also 00:15:25.490 --> 00:15:25.500 align:start position:0% stochastic heuristic agent is also 00:15:25.500 --> 00:15:26.870 align:start position:0% stochastic heuristic agent is also something<00:15:25.740> from<00:15:25.980> that<00:15:26.160> distribution<00:15:26.519> so<00:15:26.760> it's 00:15:26.870 --> 00:15:26.880 align:start position:0% something from that distribution so it's 00:15:26.880 --> 00:15:29.170 align:start position:0% something from that distribution so it's changing<00:15:27.300> but<00:15:27.899> as<00:15:28.079> we<00:15:28.260> we<00:15:28.440> can<00:15:28.620> see<00:15:28.740> direct 00:15:29.170 --> 00:15:29.180 align:start position:0% changing but as we we can see direct 00:15:29.180 --> 00:15:32.030 align:start position:0% changing but as we we can see direct moved<00:15:30.180> slightly<00:15:30.779> below<00:15:31.139> and<00:15:31.380> shrank<00:15:31.740> once 00:15:32.030 --> 00:15:32.040 align:start position:0% moved slightly below and shrank once 00:15:32.040 --> 00:15:34.610 align:start position:0% moved slightly below and shrank once again<00:15:32.160> to<00:15:32.519> capture<00:15:33.000> the<00:15:33.420> market<00:15:33.540> right<00:15:33.959> all 00:15:34.610 --> 00:15:34.620 align:start position:0% again to capture the market right all 00:15:34.620 --> 00:15:36.889 align:start position:0% again to capture the market right all right<00:15:34.800> right<00:15:35.100> I<00:15:35.699> think<00:15:35.820> it's<00:15:36.000> we<00:15:36.480> check<00:15:36.720> that 00:15:36.889 --> 00:15:36.899 align:start position:0% right right I think it's we check that 00:15:36.899 --> 00:15:39.889 align:start position:0% right right I think it's we check that property<00:15:37.320> awesome<00:15:38.100> so<00:15:39.000> how<00:15:39.180> about 00:15:39.889 --> 00:15:39.899 align:start position:0% property awesome so how about 00:15:39.899 --> 00:15:43.009 align:start position:0% property awesome so how about it<00:15:40.560> will<00:15:40.800> right<00:15:41.100> now<00:15:41.279> compete<00:15:41.880> with<00:15:42.060> like<00:15:42.779> make 00:15:43.009 --> 00:15:43.019 align:start position:0% it will right now compete with like make 00:15:43.019 --> 00:15:44.569 align:start position:0% it will right now compete with like make a<00:15:43.260> competition<00:15:43.500> where<00:15:43.800> we've<00:15:44.040> got<00:15:44.160> plenty<00:15:44.519> of 00:15:44.569 --> 00:15:44.579 align:start position:0% a competition where we've got plenty of 00:15:44.579 --> 00:15:47.930 align:start position:0% a competition where we've got plenty of those<00:15:44.699> bands<00:15:45.500> deployed<00:15:46.500> and<00:15:47.399> we<00:15:47.639> hope<00:15:47.760> that 00:15:47.930 --> 00:15:47.940 align:start position:0% those bands deployed and we hope that 00:15:47.940 --> 00:15:50.030 align:start position:0% those bands deployed and we hope that actually<00:15:48.120> this<00:15:48.600> is<00:15:48.720> the<00:15:48.899> most<00:15:49.079> inter<00:15:49.380> that's 00:15:50.030 --> 00:15:50.040 align:start position:0% actually this is the most inter that's 00:15:50.040 --> 00:15:51.470 align:start position:0% actually this is the most inter that's the<00:15:50.220> most<00:15:50.339> interesting<00:15:50.760> case<00:15:51.000> right<00:15:51.240> because 00:15:51.470 --> 00:15:51.480 align:start position:0% the most interesting case right because 00:15:51.480 --> 00:15:54.170 align:start position:0% the most interesting case right because we<00:15:51.660> want<00:15:51.839> Auto<00:15:52.079> agara<00:15:52.500> to<00:15:52.920> be<00:15:53.040> run<00:15:53.160> by<00:15:53.880> all<00:15:54.060> the 00:15:54.170 --> 00:15:54.180 align:start position:0% we want Auto agara to be run by all the 00:15:54.180 --> 00:15:56.269 align:start position:0% we want Auto agara to be run by all the indexers<00:15:54.540> in<00:15:54.720> the<00:15:54.839> graph<00:15:54.959> ecosystem 00:15:56.269 --> 00:15:56.279 align:start position:0% indexers in the graph ecosystem 00:15:56.279 --> 00:15:59.150 align:start position:0% indexers in the graph ecosystem so<00:15:56.880> same<00:15:57.540> property<00:15:58.019> slightly<00:15:58.980> different 00:15:59.150 --> 00:15:59.160 align:start position:0% so same property slightly different 00:15:59.160 --> 00:16:01.490 align:start position:0% so same property slightly different market<00:15:59.459> conditions<00:16:00.120> all<00:16:00.720> right<00:16:00.839> so<00:16:01.139> what<00:16:01.320> is 00:16:01.490 --> 00:16:01.500 align:start position:0% market conditions all right so what is 00:16:01.500 --> 00:16:02.990 align:start position:0% market conditions all right so what is happening<00:16:01.860> in<00:16:02.040> here 00:16:02.990 --> 00:16:03.000 align:start position:0% happening in here 00:16:03.000 --> 00:16:04.970 align:start position:0% happening in here sadly 00:16:04.970 --> 00:16:04.980 align:start position:0% sadly 00:16:04.980 --> 00:16:06.410 align:start position:0% sadly it's<00:16:05.399> not<00:16:05.579> good 00:16:06.410 --> 00:16:06.420 align:start position:0% it's not good 00:16:06.420 --> 00:16:09.170 align:start position:0% it's not good it's<00:16:06.959> not<00:16:07.139> good<00:16:07.320> so<00:16:07.560> that<00:16:07.740> I<00:16:07.920> just<00:16:08.160> are<00:16:08.639> acting 00:16:09.170 --> 00:16:09.180 align:start position:0% it's not good so that I just are acting 00:16:09.180 --> 00:16:11.329 align:start position:0% it's not good so that I just are acting actually<00:16:09.540> as<00:16:09.899> designed<00:16:10.440> but<00:16:10.800> as<00:16:11.040> you<00:16:11.160> can<00:16:11.279> see 00:16:11.329 --> 00:16:11.339 align:start position:0% actually as designed but as you can see 00:16:11.339 --> 00:16:12.470 align:start position:0% actually as designed but as you can see they're<00:16:11.579> like 00:16:12.470 --> 00:16:12.480 align:start position:0% they're like 00:16:12.480 --> 00:16:15.350 align:start position:0% they're like fighting<00:16:13.440> fighting<00:16:13.860> fighting<00:16:14.279> going<00:16:14.519> moving 00:16:15.350 --> 00:16:15.360 align:start position:0% fighting fighting fighting going moving 00:16:15.360 --> 00:16:16.790 align:start position:0% fighting fighting fighting going moving moving<00:16:15.720> to<00:16:15.839> the<00:16:16.019> left<00:16:16.079> hand<00:16:16.260> side<00:16:16.500> which<00:16:16.680> means 00:16:16.790 --> 00:16:16.800 align:start position:0% moving to the left hand side which means 00:16:16.800 --> 00:16:18.290 align:start position:0% moving to the left hand side which means that<00:16:16.980> they're<00:16:17.100> lowering<00:16:17.519> their<00:16:17.760> prices<00:16:17.940> all 00:16:18.290 --> 00:16:18.300 align:start position:0% that they're lowering their prices all 00:16:18.300 --> 00:16:20.090 align:start position:0% that they're lowering their prices all the<00:16:18.480> time<00:16:18.600> right<00:16:18.839> and<00:16:19.440> as<00:16:19.560> you<00:16:19.740> can<00:16:19.860> see<00:16:19.920> in 00:16:20.090 --> 00:16:20.100 align:start position:0% the time right and as you can see in 00:16:20.100 --> 00:16:22.550 align:start position:0% the time right and as you can see in here<00:16:20.399> oh<00:16:21.060> you<00:16:21.360> can<00:16:21.420> see<00:16:21.600> the<00:16:21.779> labels<00:16:22.079> but<00:16:22.320> this 00:16:22.550 --> 00:16:22.560 align:start position:0% here oh you can see the labels but this 00:16:22.560 --> 00:16:24.050 align:start position:0% here oh you can see the labels but this is<00:16:22.680> this<00:16:23.100> is<00:16:23.220> the<00:16:23.339> revenue<00:16:23.639> that<00:16:23.940> they're 00:16:24.050 --> 00:16:24.060 align:start position:0% is this is the revenue that they're 00:16:24.060 --> 00:16:26.030 align:start position:0% is this is the revenue that they're getting<00:16:24.360> right<00:16:24.899> at<00:16:25.260> a<00:16:25.440> given<00:16:25.680> time<00:16:25.800> step 00:16:26.030 --> 00:16:26.040 align:start position:0% getting right at a given time step 00:16:26.040 --> 00:16:27.769 align:start position:0% getting right at a given time step basically<00:16:26.579> it's<00:16:26.639> going<00:16:26.820> it's<00:16:27.180> converging<00:16:27.600> to 00:16:27.769 --> 00:16:27.779 align:start position:0% basically it's going it's converging to 00:16:27.779 --> 00:16:31.069 align:start position:0% basically it's going it's converging to zero<00:16:28.260> which<00:16:28.680> means<00:16:28.980> that<00:16:29.160> after<00:16:29.699> a<00:16:30.000> while<00:16:30.120> the 00:16:31.069 --> 00:16:31.079 align:start position:0% zero which means that after a while the 00:16:31.079 --> 00:16:32.810 align:start position:0% zero which means that after a while the digest<00:16:31.620> will<00:16:31.860> be<00:16:31.920> basically<00:16:32.279> serving<00:16:32.699> for 00:16:32.810 --> 00:16:32.820 align:start position:0% digest will be basically serving for 00:16:32.820 --> 00:16:34.850 align:start position:0% digest will be basically serving for free<00:16:33.000> right<00:16:33.420> and<00:16:33.839> so<00:16:34.139> that's<00:16:34.320> not<00:16:34.560> a<00:16:34.740> good 00:16:34.850 --> 00:16:34.860 align:start position:0% free right and so that's not a good 00:16:34.860 --> 00:16:36.650 align:start position:0% free right and so that's not a good situation<00:16:35.160> for<00:16:35.399> the<00:16:35.579> indexers<00:16:36.000> right<00:16:36.240> because 00:16:36.650 --> 00:16:36.660 align:start position:0% situation for the indexers right because 00:16:36.660 --> 00:16:38.810 align:start position:0% situation for the indexers right because in<00:16:36.899> here<00:16:37.079> we<00:16:37.259> are<00:16:37.320> not<00:16:37.500> even<00:16:37.620> modeling<00:16:38.100> the<00:16:38.339> we 00:16:38.810 --> 00:16:38.820 align:start position:0% in here we are not even modeling the we 00:16:38.820 --> 00:16:41.090 align:start position:0% in here we are not even modeling the we are<00:16:38.940> modeling<00:16:39.360> the<00:16:39.480> revenue<00:16:39.720> not<00:16:40.079> the<00:16:40.320> not<00:16:40.860> the 00:16:41.090 --> 00:16:41.100 align:start position:0% are modeling the revenue not the not the 00:16:41.100 --> 00:16:43.370 align:start position:0% are modeling the revenue not the not the we<00:16:41.880> are<00:16:42.000> not<00:16:42.060> modeling<00:16:42.480> the<00:16:42.600> costs<00:16:42.959> right<00:16:43.139> so 00:16:43.370 --> 00:16:43.380 align:start position:0% we are not modeling the costs right so 00:16:43.380 --> 00:16:44.870 align:start position:0% we are not modeling the costs right so at<00:16:43.560> that<00:16:43.680> point<00:16:43.800> agents<00:16:44.339> will<00:16:44.459> be<00:16:44.579> well 00:16:44.870 --> 00:16:44.880 align:start position:0% at that point agents will be well 00:16:44.880 --> 00:16:48.290 align:start position:0% at that point agents will be well indexes<00:16:45.420> will<00:16:45.600> be<00:16:45.779> actually<00:16:46.279> uh<00:16:47.279> well 00:16:48.290 --> 00:16:48.300 align:start position:0% indexes will be actually uh well 00:16:48.300 --> 00:16:50.629 align:start position:0% indexes will be actually uh well paying<00:16:49.139> for<00:16:49.259> that<00:16:49.680> instead<00:16:50.040> of<00:16:50.160> making<00:16:50.339> money 00:16:50.629 --> 00:16:50.639 align:start position:0% paying for that instead of making money 00:16:50.639 --> 00:16:53.749 align:start position:0% paying for that instead of making money all<00:16:51.000> right<00:16:51.120> so<00:16:51.300> we<00:16:51.480> call<00:16:51.600> this<00:16:51.839> this<00:16:52.740> this<00:16:52.920> uh 00:16:53.749 --> 00:16:53.759 align:start position:0% all right so we call this this this uh 00:16:53.759 --> 00:16:55.730 align:start position:0% all right so we call this this this uh phenomenon<00:16:54.360> or<00:16:54.540> this<00:16:54.779> outcome<00:16:55.079> raised<00:16:55.500> to<00:16:55.560> the 00:16:55.730 --> 00:16:55.740 align:start position:0% phenomenon or this outcome raised to the 00:16:55.740 --> 00:16:57.769 align:start position:0% phenomenon or this outcome raised to the bottom<00:16:56.040> and<00:16:56.339> we<00:16:56.519> run<00:16:56.759> many<00:16:56.940> simulations<00:16:57.420> we 00:16:57.769 --> 00:16:57.779 align:start position:0% bottom and we run many simulations we 00:16:57.779 --> 00:16:59.870 align:start position:0% bottom and we run many simulations we discussed<00:16:58.139> that<00:16:58.259> a<00:16:58.440> lot<00:16:58.560> and<00:16:59.459> actually<00:16:59.639> we 00:16:59.870 --> 00:16:59.880 align:start position:0% discussed that a lot and actually we 00:16:59.880 --> 00:17:01.550 align:start position:0% discussed that a lot and actually we realized<00:17:00.240> that<00:17:00.420> well<00:17:00.779> this<00:17:00.959> is<00:17:01.079> the<00:17:01.199> expected 00:17:01.550 --> 00:17:01.560 align:start position:0% realized that well this is the expected 00:17:01.560 --> 00:17:04.250 align:start position:0% realized that well this is the expected Behavior<00:17:01.920> right<00:17:02.160> in<00:17:02.399> this<00:17:02.579> setup<00:17:02.880> so<00:17:03.600> we've 00:17:04.250 --> 00:17:04.260 align:start position:0% Behavior right in this setup so we've 00:17:04.260 --> 00:17:05.569 align:start position:0% Behavior right in this setup so we've got<00:17:04.319> some<00:17:04.500> images<00:17:04.679> that<00:17:05.160> are<00:17:05.339> basically 00:17:05.569 --> 00:17:05.579 align:start position:0% got some images that are basically 00:17:05.579 --> 00:17:07.730 align:start position:0% got some images that are basically trying<00:17:05.819> to<00:17:06.000> snatch<00:17:06.299> the<00:17:06.480> market<00:17:06.600> right<00:17:07.079> and 00:17:07.730 --> 00:17:07.740 align:start position:0% trying to snatch the market right and 00:17:07.740 --> 00:17:10.130 align:start position:0% trying to snatch the market right and they're<00:17:08.220> purely<00:17:08.579> driven<00:17:08.880> by<00:17:09.059> by<00:17:09.299> the<00:17:09.540> by<00:17:09.900> the 00:17:10.130 --> 00:17:10.140 align:start position:0% they're purely driven by by the by the 00:17:10.140 --> 00:17:11.870 align:start position:0% they're purely driven by by the by the query<00:17:10.679> volume<00:17:10.919> right 00:17:11.870 --> 00:17:11.880 align:start position:0% query volume right 00:17:11.880 --> 00:17:14.030 align:start position:0% query volume right so<00:17:12.480> if<00:17:12.959> this<00:17:13.140> is<00:17:13.260> the<00:17:13.380> case<00:17:13.620> and<00:17:13.860> the 00:17:14.030 --> 00:17:14.040 align:start position:0% so if this is the case and the 00:17:14.040 --> 00:17:15.949 align:start position:0% so if this is the case and the environment<00:17:14.459> just<00:17:14.760> natively<00:17:15.240> distributes 00:17:15.949 --> 00:17:15.959 align:start position:0% environment just natively distributes 00:17:15.959 --> 00:17:17.569 align:start position:0% environment just natively distributes you<00:17:16.319> know<00:17:16.380> the<00:17:16.500> queries<00:17:16.860> based<00:17:17.160> on<00:17:17.220> the<00:17:17.400> the 00:17:17.569 --> 00:17:17.579 align:start position:0% you know the queries based on the the 00:17:17.579 --> 00:17:19.669 align:start position:0% you know the queries based on the the price<00:17:17.760> bit<00:17:18.059> rest<00:17:18.600> of<00:17:18.839> the<00:17:18.959> bottom<00:17:19.199> is<00:17:19.500> the 00:17:19.669 --> 00:17:19.679 align:start position:0% price bit rest of the bottom is the 00:17:19.679 --> 00:17:22.370 align:start position:0% price bit rest of the bottom is the expected<00:17:20.220> is<00:17:20.699> the<00:17:20.880> expected<00:17:21.299> outcome<00:17:21.600> right 00:17:22.370 --> 00:17:22.380 align:start position:0% expected is the expected outcome right 00:17:22.380 --> 00:17:25.549 align:start position:0% expected is the expected outcome right so<00:17:23.040> it<00:17:23.280> can<00:17:23.400> be<00:17:23.520> addressed<00:17:23.880> in<00:17:23.939> many<00:17:24.120> ways<00:17:24.959> but 00:17:25.549 --> 00:17:25.559 align:start position:0% so it can be addressed in many ways but 00:17:25.559 --> 00:17:27.110 align:start position:0% so it can be addressed in many ways but we<00:17:25.740> look<00:17:25.919> at<00:17:26.040> the<00:17:26.160> graph<00:17:26.339> protocols<00:17:26.880> what<00:17:27.000> are 00:17:27.110 --> 00:17:27.120 align:start position:0% we look at the graph protocols what are 00:17:27.120 --> 00:17:28.610 align:start position:0% we look at the graph protocols what are the<00:17:27.240> features<00:17:27.480> right<00:17:27.720> and<00:17:27.959> down<00:17:28.319> there<00:17:28.439> and 00:17:28.610 --> 00:17:28.620 align:start position:0% the features right and down there and 00:17:28.620 --> 00:17:29.750 align:start position:0% the features right and down there and what<00:17:28.860> are<00:17:28.980> the<00:17:29.100> assumptions<00:17:29.460> so<00:17:29.640> one 00:17:29.750 --> 00:17:29.760 align:start position:0% what are the assumptions so one 00:17:29.760 --> 00:17:31.070 align:start position:0% what are the assumptions so one assumption<00:17:30.179> is<00:17:30.240> that<00:17:30.419> all<00:17:30.540> the<00:17:30.600> elixirs 00:17:31.070 --> 00:17:31.080 align:start position:0% assumption is that all the elixirs 00:17:31.080 --> 00:17:32.450 align:start position:0% assumption is that all the elixirs should<00:17:31.140> have<00:17:31.320> freedom<00:17:31.679> with<00:17:31.980> their<00:17:32.160> pricing 00:17:32.450 --> 00:17:32.460 align:start position:0% should have freedom with their pricing 00:17:32.460 --> 00:17:34.370 align:start position:0% should have freedom with their pricing right<00:17:32.640> there<00:17:32.880> should<00:17:33.059> be<00:17:33.120> any<00:17:33.299> limitations<00:17:33.840> so 00:17:34.370 --> 00:17:34.380 align:start position:0% right there should be any limitations so 00:17:34.380 --> 00:17:36.590 align:start position:0% right there should be any limitations so that<00:17:34.559> if<00:17:34.740> they<00:17:34.980> can<00:17:35.160> if<00:17:35.640> they<00:17:35.820> want<00:17:35.940> to<00:17:36.120> serve 00:17:36.590 --> 00:17:36.600 align:start position:0% that if they can if they want to serve 00:17:36.600 --> 00:17:38.930 align:start position:0% that if they can if they want to serve queries<00:17:36.960> superb<00:17:37.740> that<00:17:38.160> are<00:17:38.280> super<00:17:38.460> expensive 00:17:38.930 --> 00:17:38.940 align:start position:0% queries superb that are super expensive 00:17:38.940 --> 00:17:41.270 align:start position:0% queries superb that are super expensive or<00:17:39.120> super<00:17:39.299> cheap<00:17:39.600> it's<00:17:40.200> okay<00:17:40.380> and<00:17:41.039> all<00:17:41.160> the 00:17:41.270 --> 00:17:41.280 align:start position:0% or super cheap it's okay and all the 00:17:41.280 --> 00:17:42.650 align:start position:0% or super cheap it's okay and all the indexers<00:17:41.700> should<00:17:41.880> be<00:17:42.059> able<00:17:42.179> to<00:17:42.299> make<00:17:42.480> any 00:17:42.650 --> 00:17:42.660 align:start position:0% indexers should be able to make any 00:17:42.660 --> 00:17:43.970 align:start position:0% indexers should be able to make any profits<00:17:43.140> so<00:17:43.260> the<00:17:43.380> conclusion<00:17:43.679> was<00:17:43.860> that 00:17:43.970 --> 00:17:43.980 align:start position:0% profits so the conclusion was that 00:17:43.980 --> 00:17:45.830 align:start position:0% profits so the conclusion was that actually<00:17:44.220> is<00:17:44.460> the<00:17:44.640> Gateway<00:17:44.940> right<00:17:45.179> that<00:17:45.480> the 00:17:45.830 --> 00:17:45.840 align:start position:0% actually is the Gateway right that the 00:17:45.840 --> 00:17:47.570 align:start position:0% actually is the Gateway right that the thing<00:17:46.020> that<00:17:46.140> controls<00:17:46.559> the<00:17:46.740> market<00:17:46.919> should 00:17:47.570 --> 00:17:47.580 align:start position:0% thing that controls the market should 00:17:47.580 --> 00:17:49.490 align:start position:0% thing that controls the market should implement<00:17:47.940> this<00:17:48.120> kind<00:17:48.299> of<00:17:48.500> anti-dominant 00:17:49.490 --> 00:17:49.500 align:start position:0% implement this kind of anti-dominant 00:17:49.500 --> 00:17:51.710 align:start position:0% implement this kind of anti-dominant policy<00:17:49.919> and<00:17:50.220> so<00:17:50.460> happened<00:17:50.640> it<00:17:51.240> does<00:17:51.419> it 00:17:51.710 --> 00:17:51.720 align:start position:0% policy and so happened it does it 00:17:51.720 --> 00:17:53.990 align:start position:0% policy and so happened it does it already<00:17:51.900> does<00:17:52.200> so<00:17:52.679> in<00:17:52.980> our<00:17:53.160> next<00:17:53.340> step<00:17:53.520> what<00:17:53.820> we 00:17:53.990 --> 00:17:54.000 align:start position:0% already does so in our next step what we 00:17:54.000 --> 00:17:56.150 align:start position:0% already does so in our next step what we did<00:17:54.179> we<00:17:54.539> wrapped<00:17:54.900> the<00:17:55.020> existing<00:17:55.380> isi<00:17:55.919> right 00:17:56.150 --> 00:17:56.160 align:start position:0% did we wrapped the existing isi right 00:17:56.160 --> 00:17:58.130 align:start position:0% did we wrapped the existing isi right the<00:17:56.340> Isis<00:17:56.700> index<00:17:57.120> selection<00:17:57.600> algorithm<00:17:58.020> is 00:17:58.130 --> 00:17:58.140 align:start position:0% the Isis index selection algorithm is 00:17:58.140 --> 00:17:59.630 align:start position:0% the Isis index selection algorithm is one<00:17:58.320> of<00:17:58.380> the<00:17:58.500> components<00:17:58.919> of<00:17:59.039> the<00:17:59.160> of<00:17:59.340> the<00:17:59.520> of 00:17:59.630 --> 00:17:59.640 align:start position:0% one of the components of the of the of 00:17:59.640 --> 00:18:01.610 align:start position:0% one of the components of the of the of the<00:17:59.760> Gateway<00:18:00.059> right<00:18:00.360> so<00:18:00.960> we<00:18:01.080> just<00:18:01.260> wrapped<00:18:01.559> it 00:18:01.610 --> 00:18:01.620 align:start position:0% the Gateway right so we just wrapped it 00:18:01.620 --> 00:18:03.470 align:start position:0% the Gateway right so we just wrapped it in<00:18:01.740> here<00:18:01.860> and<00:18:02.039> using<00:18:02.340> the<00:18:02.520> simulation<00:18:03.059> we<00:18:03.299> are 00:18:03.470 --> 00:18:03.480 align:start position:0% in here and using the simulation we are 00:18:03.480 --> 00:18:05.270 align:start position:0% in here and using the simulation we are once<00:18:03.720> again<00:18:03.780> testing<00:18:04.440> the<00:18:04.620> same<00:18:04.799> conditions 00:18:05.270 --> 00:18:05.280 align:start position:0% once again testing the same conditions 00:18:05.280 --> 00:18:07.190 align:start position:0% once again testing the same conditions right<00:18:05.460> competing<00:18:06.240> you<00:18:06.480> know<00:18:06.600> many<00:18:06.780> versions 00:18:07.190 --> 00:18:07.200 align:start position:0% right competing you know many versions 00:18:07.200 --> 00:18:08.870 align:start position:0% right competing you know many versions many<00:18:07.440> government<00:18:07.740> is<00:18:08.280> competing<00:18:08.580> with<00:18:08.760> each 00:18:08.870 --> 00:18:08.880 align:start position:0% many government is competing with each 00:18:08.880 --> 00:18:10.669 align:start position:0% many government is competing with each other<00:18:09.000> and<00:18:09.600> the<00:18:09.720> property<00:18:10.020> okay<00:18:10.200> can<00:18:10.500> we 00:18:10.669 --> 00:18:10.679 align:start position:0% other and the property okay can we 00:18:10.679 --> 00:18:13.430 align:start position:0% other and the property okay can we discover<00:18:10.860> each<00:18:11.640> other<00:18:11.820> prices<00:18:12.120> and<00:18:12.440> maximize 00:18:13.430 --> 00:18:13.440 align:start position:0% discover each other prices and maximize 00:18:13.440 --> 00:18:16.430 align:start position:0% discover each other prices and maximize our<00:18:13.620> profits<00:18:14.340> so<00:18:15.120> the<00:18:15.660> outcome<00:18:16.020> is<00:18:16.140> totally 00:18:16.430 --> 00:18:16.440 align:start position:0% our profits so the outcome is totally 00:18:16.440 --> 00:18:19.070 align:start position:0% our profits so the outcome is totally different<00:18:16.679> right<00:18:17.280> we<00:18:17.820> ready<00:18:18.179> by<00:18:18.660> changing 00:18:19.070 --> 00:18:19.080 align:start position:0% different right we ready by changing 00:18:19.080 --> 00:18:22.430 align:start position:0% different right we ready by changing changing<00:18:19.740> the<00:18:19.919> way<00:18:20.100> the<00:18:20.780> the<00:18:21.780> queries<00:18:22.320> are 00:18:22.430 --> 00:18:22.440 align:start position:0% changing the way the the queries are 00:18:22.440 --> 00:18:25.370 align:start position:0% changing the way the the queries are distributed<00:18:22.980> actually<00:18:23.820> you<00:18:24.120> reach<00:18:24.480> the<00:18:25.260> like 00:18:25.370 --> 00:18:25.380 align:start position:0% distributed actually you reach the like 00:18:25.380 --> 00:18:27.590 align:start position:0% distributed actually you reach the like a<00:18:25.559> consensus<00:18:26.039> right<00:18:26.280> so<00:18:26.580> that<00:18:26.820> all<00:18:27.059> the<00:18:27.179> agents 00:18:27.590 --> 00:18:27.600 align:start position:0% a consensus right so that all the agents 00:18:27.600 --> 00:18:30.230 align:start position:0% a consensus right so that all the agents are<00:18:28.260> discovering<00:18:28.860> the<00:18:29.100> markets<00:18:29.580> right<00:18:29.760> what 00:18:30.230 --> 00:18:30.240 align:start position:0% are discovering the markets right what 00:18:30.240 --> 00:18:33.049 align:start position:0% are discovering the markets right what was<00:18:30.539> the<00:18:30.720> market<00:18:30.900> at<00:18:31.679> the<00:18:31.860> same<00:18:31.980> Gateway<00:18:32.880> is 00:18:33.049 --> 00:18:33.059 align:start position:0% was the market at the same Gateway is 00:18:33.059 --> 00:18:34.850 align:start position:0% was the market at the same Gateway is looking<00:18:33.240> the<00:18:33.600> ISA<00:18:34.080> is<00:18:34.200> looking<00:18:34.380> at<00:18:34.620> their 00:18:34.850 --> 00:18:34.860 align:start position:0% looking the ISA is looking at their 00:18:34.860 --> 00:18:37.430 align:start position:0% looking the ISA is looking at their their<00:18:35.160> quality<00:18:35.520> of<00:18:35.700> service<00:18:35.940> uh<00:18:36.600> at<00:18:37.140> their 00:18:37.430 --> 00:18:37.440 align:start position:0% their quality of service uh at their 00:18:37.440 --> 00:18:39.830 align:start position:0% their quality of service uh at their prices<00:18:37.620> and<00:18:38.160> trying<00:18:38.340> to<00:18:38.640> like<00:18:39.179> feed<00:18:39.600> everyone 00:18:39.830 --> 00:18:39.840 align:start position:0% prices and trying to like feed everyone 00:18:39.840 --> 00:18:42.289 align:start position:0% prices and trying to like feed everyone right<00:18:40.320> not<00:18:40.740> just<00:18:40.860> okay<00:18:41.160> you're<00:18:41.820> the<00:18:42.059> winner 00:18:42.289 --> 00:18:42.299 align:start position:0% right not just okay you're the winner 00:18:42.299 --> 00:18:44.150 align:start position:0% right not just okay you're the winner you're<00:18:42.840> you're<00:18:43.080> searching<00:18:43.500> all<00:18:43.620> the<00:18:43.799> queries 00:18:44.150 --> 00:18:44.160 align:start position:0% you're you're searching all the queries 00:18:44.160 --> 00:18:45.890 align:start position:0% you're you're searching all the queries all<00:18:44.700> right<00:18:44.820> so<00:18:44.940> this<00:18:45.179> is<00:18:45.240> really<00:18:45.419> nice<00:18:45.660> so 00:18:45.890 --> 00:18:45.900 align:start position:0% all right so this is really nice so 00:18:45.900 --> 00:18:47.630 align:start position:0% all right so this is really nice so please<00:18:46.500> note<00:18:46.740> that<00:18:46.919> the<00:18:47.039> gate<00:18:47.220> will<00:18:47.400> also 00:18:47.630 --> 00:18:47.640 align:start position:0% please note that the gate will also 00:18:47.640 --> 00:18:50.450 align:start position:0% please note that the gate will also leave<00:18:47.820> some<00:18:48.000> kind<00:18:48.179> of<00:18:48.299> budget<00:18:48.840> right<00:18:49.559> that<00:18:50.039> is 00:18:50.450 --> 00:18:50.460 align:start position:0% leave some kind of budget right that is 00:18:50.460 --> 00:18:52.190 align:start position:0% leave some kind of budget right that is the<00:18:50.700> this<00:18:51.000> design<00:18:51.179> such<00:18:51.539> a<00:18:51.660> way<00:18:51.780> that<00:18:51.960> actually 00:18:52.190 --> 00:18:52.200 align:start position:0% the this design such a way that actually 00:18:52.200 --> 00:18:54.950 align:start position:0% the this design such a way that actually it's<00:18:52.980> it's<00:18:53.220> not<00:18:53.460> enabling<00:18:53.880> the<00:18:54.120> agents<00:18:54.539> to<00:18:54.660> to 00:18:54.950 --> 00:18:54.960 align:start position:0% it's it's not enabling the agents to to 00:18:54.960 --> 00:18:56.690 align:start position:0% it's it's not enabling the agents to to consume<00:18:55.440> all<00:18:55.559> the<00:18:55.740> budgets<00:18:56.160> right<00:18:56.280> so<00:18:56.520> the 00:18:56.690 --> 00:18:56.700 align:start position:0% consume all the budgets right so the 00:18:56.700 --> 00:18:59.150 align:start position:0% consume all the budgets right so the budget<00:18:57.000> is<00:18:57.179> there<00:18:57.900> is<00:18:58.080> a<00:18:58.260> portion<00:18:58.740> that<00:18:59.039> is 00:18:59.150 --> 00:18:59.160 align:start position:0% budget is there is a portion that is 00:18:59.160 --> 00:19:00.529 align:start position:0% budget is there is a portion that is left<00:18:59.400> to<00:18:59.700> the 00:19:00.529 --> 00:19:00.539 align:start position:0% left to the 00:19:00.539 --> 00:19:02.210 align:start position:0% left to the to<00:19:01.440> the 00:19:02.210 --> 00:19:02.220 align:start position:0% to the 00:19:02.220 --> 00:19:04.130 align:start position:0% to the let's<00:19:02.640> say<00:19:02.820> to<00:19:03.000> the<00:19:03.179> customer 00:19:04.130 --> 00:19:04.140 align:start position:0% let's say to the customer 00:19:04.140 --> 00:19:05.750 align:start position:0% let's say to the customer okay<00:19:04.620> so<00:19:04.860> we're<00:19:04.980> on<00:19:05.220> some<00:19:05.280> more<00:19:05.400> simulations 00:19:05.750 --> 00:19:05.760 align:start position:0% okay so we're on some more simulations 00:19:05.760 --> 00:19:07.490 align:start position:0% okay so we're on some more simulations of<00:19:06.000> course<00:19:06.120> it's<00:19:06.240> like<00:19:06.419> okay<00:19:06.600> free<00:19:06.900> can<00:19:07.260> we<00:19:07.380> run 00:19:07.490 --> 00:19:07.500 align:start position:0% of course it's like okay free can we run 00:19:07.500 --> 00:19:09.230 align:start position:0% of course it's like okay free can we run that<00:19:07.679> with<00:19:07.860> 10<00:19:08.100> 20<00:19:08.280> agents<00:19:08.760> right<00:19:08.880> will<00:19:09.059> that 00:19:09.230 --> 00:19:09.240 align:start position:0% that with 10 20 agents right will that 00:19:09.240 --> 00:19:11.330 align:start position:0% that with 10 20 agents right will that still<00:19:09.419> work<00:19:09.660> it<00:19:10.140> seems<00:19:10.440> yes<00:19:10.620> it<00:19:10.860> does<00:19:11.039> so<00:19:11.220> we 00:19:11.330 --> 00:19:11.340 align:start position:0% still work it seems yes it does so we 00:19:11.340 --> 00:19:12.470 align:start position:0% still work it seems yes it does so we are<00:19:11.460> testing<00:19:11.700> the<00:19:11.820> same<00:19:12.000> properties<00:19:12.240> right 00:19:12.470 --> 00:19:12.480 align:start position:0% are testing the same properties right 00:19:12.480 --> 00:19:14.150 align:start position:0% are testing the same properties right which<00:19:12.780> are<00:19:12.960> just<00:19:13.140> a<00:19:13.500> little<00:19:13.620> bit<00:19:13.740> changing<00:19:14.100> the 00:19:14.150 --> 00:19:14.160 align:start position:0% which are just a little bit changing the 00:19:14.160 --> 00:19:15.710 align:start position:0% which are just a little bit changing the market<00:19:14.340> conditions 00:19:15.710 --> 00:19:15.720 align:start position:0% market conditions 00:19:15.720 --> 00:19:18.590 align:start position:0% market conditions right<00:19:16.140> this<00:19:16.799> is<00:19:16.919> looking<00:19:17.520> really<00:19:17.820> good<00:19:18.059> if<00:19:18.480> you 00:19:18.590 --> 00:19:18.600 align:start position:0% right this is looking really good if you 00:19:18.600 --> 00:19:20.390 align:start position:0% right this is looking really good if you look<00:19:18.720> at<00:19:18.840> look<00:19:19.080> at<00:19:19.200> the<00:19:19.380> the<00:19:19.559> query<00:19:19.860> serve<00:19:20.280> and 00:19:20.390 --> 00:19:20.400 align:start position:0% look at look at the the query serve and 00:19:20.400 --> 00:19:23.810 align:start position:0% look at look at the the query serve and the<00:19:20.580> revenue<00:19:20.820> it's<00:19:21.600> like<00:19:21.840> all<00:19:22.200> the<00:19:22.380> agents<00:19:22.740> are 00:19:23.810 --> 00:19:23.820 align:start position:0% the revenue it's like all the agents are 00:19:23.820 --> 00:19:26.810 align:start position:0% the revenue it's like all the agents are you<00:19:24.299> know<00:19:24.419> are<00:19:24.960> are<00:19:25.320> making<00:19:25.620> money<00:19:26.340> which<00:19:26.640> is 00:19:26.810 --> 00:19:26.820 align:start position:0% you know are are making money which is 00:19:26.820 --> 00:19:29.630 align:start position:0% you know are are making money which is the<00:19:27.120> desired<00:19:27.600> the<00:19:28.200> desired<00:19:28.679> uh<00:19:29.280> Behavior 00:19:29.630 --> 00:19:29.640 align:start position:0% the desired the desired uh Behavior 00:19:29.640 --> 00:19:31.909 align:start position:0% the desired the desired uh Behavior right<00:19:29.940> and<00:19:30.840> they<00:19:31.020> are<00:19:31.200> rediscovering<00:19:31.799> the 00:19:31.909 --> 00:19:31.919 align:start position:0% right and they are rediscovering the 00:19:31.919 --> 00:19:35.630 align:start position:0% right and they are rediscovering the market<00:19:32.100> cool<00:19:32.940> so<00:19:33.780> what<00:19:34.080> we<00:19:34.260> also<00:19:34.559> did 00:19:35.630 --> 00:19:35.640 align:start position:0% market cool so what we also did 00:19:35.640 --> 00:19:37.490 align:start position:0% market cool so what we also did uh 00:19:37.490 --> 00:19:37.500 align:start position:0% uh 00:19:37.500 --> 00:19:40.310 align:start position:0% uh we<00:19:38.460> we<00:19:38.940> started<00:19:39.360> we<00:19:39.600> wanted<00:19:39.840> to<00:19:40.020> see<00:19:40.140> whether 00:19:40.310 --> 00:19:40.320 align:start position:0% we we started we wanted to see whether 00:19:40.320 --> 00:19:41.810 align:start position:0% we we started we wanted to see whether okay<00:19:40.620> so<00:19:40.980> how<00:19:41.100> about<00:19:41.220> different<00:19:41.400> initial 00:19:41.810 --> 00:19:41.820 align:start position:0% okay so how about different initial 00:19:41.820 --> 00:19:43.310 align:start position:0% okay so how about different initial conditions<00:19:42.299> right<00:19:42.480> so<00:19:42.660> we're<00:19:42.780> assuming<00:19:43.140> that 00:19:43.310 --> 00:19:43.320 align:start position:0% conditions right so we're assuming that 00:19:43.320 --> 00:19:44.810 align:start position:0% conditions right so we're assuming that different<00:19:43.500> different<00:19:43.799> in<00:19:44.160> Xmas<00:19:44.520> that<00:19:44.700> okay 00:19:44.810 --> 00:19:44.820 align:start position:0% different different in Xmas that okay 00:19:44.820 --> 00:19:47.029 align:start position:0% different different in Xmas that okay that's<00:19:45.120> my<00:19:45.360> mean<00:19:45.720> price<00:19:46.020> that's<00:19:46.320> my<00:19:46.559> variance 00:19:47.029 --> 00:19:47.039 align:start position:0% that's my mean price that's my variance 00:19:47.039 --> 00:19:49.430 align:start position:0% that's my mean price that's my variance I<00:19:47.580> want<00:19:47.760> to<00:19:47.880> maybe<00:19:48.299> move<00:19:48.660> a<00:19:49.080> bit<00:19:49.200> more 00:19:49.430 --> 00:19:49.440 align:start position:0% I want to maybe move a bit more 00:19:49.440 --> 00:19:51.350 align:start position:0% I want to maybe move a bit more expensive<00:19:49.860> for<00:19:50.039> like<00:19:50.220> less<00:19:50.520> expensive<00:19:51.120> other 00:19:51.350 --> 00:19:51.360 align:start position:0% expensive for like less expensive other 00:19:51.360 --> 00:19:53.630 align:start position:0% expensive for like less expensive other being<00:19:51.660> wanted<00:19:51.960> to<00:19:52.140> see<00:19:52.260> whether<00:19:52.500> the<00:19:53.340> the<00:19:53.580> the 00:19:53.630 --> 00:19:53.640 align:start position:0% being wanted to see whether the the the 00:19:53.640 --> 00:19:57.169 align:start position:0% being wanted to see whether the the the the<00:19:54.419> the<00:19:54.480> system<00:19:55.080> will<00:19:55.380> converge<00:19:56.280> to<00:19:57.059> that 00:19:57.169 --> 00:19:57.179 align:start position:0% the the system will converge to that 00:19:57.179 --> 00:19:59.510 align:start position:0% the the system will converge to that equilibrium<00:19:57.840> and<00:19:58.679> it<00:19:58.860> seems<00:19:59.160> that<00:19:59.220> this<00:19:59.400> is 00:19:59.510 --> 00:19:59.520 align:start position:0% equilibrium and it seems that this is 00:19:59.520 --> 00:20:01.370 align:start position:0% equilibrium and it seems that this is really<00:19:59.700> happening<00:20:00.120> right<00:20:00.360> so<00:20:00.720> disregard<00:20:01.200> the 00:20:01.370 --> 00:20:01.380 align:start position:0% really happening right so disregard the 00:20:01.380 --> 00:20:04.850 align:start position:0% really happening right so disregard the initial<00:20:01.679> conditions<00:20:02.520> this<00:20:03.059> is<00:20:03.179> good<00:20:03.840> we<00:20:04.620> also 00:20:04.850 --> 00:20:04.860 align:start position:0% initial conditions this is good we also 00:20:04.860 --> 00:20:06.770 align:start position:0% initial conditions this is good we also run<00:20:04.980> some<00:20:05.220> additional<00:20:05.640> experiments<00:20:06.419> with 00:20:06.770 --> 00:20:06.780 align:start position:0% run some additional experiments with 00:20:06.780 --> 00:20:08.810 align:start position:0% run some additional experiments with with<00:20:07.140> frequent<00:20:07.620> a<00:20:07.740> stronger<00:20:08.100> policy<00:20:08.520> updates 00:20:08.810 --> 00:20:08.820 align:start position:0% with frequent a stronger policy updates 00:20:08.820 --> 00:20:12.169 align:start position:0% with frequent a stronger policy updates so<00:20:09.539> this<00:20:09.960> one<00:20:10.080> is<00:20:10.440> our<00:20:10.679> modified<00:20:11.100> PPO<00:20:11.640> agent<00:20:12.000> as 00:20:12.169 --> 00:20:12.179 align:start position:0% so this one is our modified PPO agent as 00:20:12.179 --> 00:20:14.150 align:start position:0% so this one is our modified PPO agent as you<00:20:12.299> can<00:20:12.360> see<00:20:12.480> it's<00:20:12.720> much<00:20:12.960> faster<00:20:13.260> than<00:20:13.620> okay 00:20:14.150 --> 00:20:14.160 align:start position:0% you can see it's much faster than okay 00:20:14.160 --> 00:20:16.190 align:start position:0% you can see it's much faster than okay the<00:20:14.520> red<00:20:14.640> agent<00:20:15.120> is<00:20:15.240> the<00:20:15.419> vanilla<00:20:15.840> policy 00:20:16.190 --> 00:20:16.200 align:start position:0% the red agent is the vanilla policy 00:20:16.200 --> 00:20:18.230 align:start position:0% the red agent is the vanilla policy gradients<00:20:16.679> like<00:20:16.860> parallel<00:20:17.400> mental<00:20:17.820> policy 00:20:18.230 --> 00:20:18.240 align:start position:0% gradients like parallel mental policy 00:20:18.240 --> 00:20:20.930 align:start position:0% gradients like parallel mental policy Elementary<00:20:18.960> update<00:20:19.500> rule 00:20:20.930 --> 00:20:20.940 align:start position:0% Elementary update rule 00:20:20.940 --> 00:20:24.010 align:start position:0% Elementary update rule and<00:20:21.660> the<00:20:21.840> other<00:20:21.960> one<00:20:22.140> is<00:20:22.320> just<00:20:22.559> pure 00:20:24.010 --> 00:20:24.020 align:start position:0% and the other one is just pure 00:20:24.020 --> 00:20:26.450 align:start position:0% and the other one is just pure PPO<00:20:25.020> right<00:20:25.320> so<00:20:25.500> our<00:20:25.679> agent<00:20:25.980> is<00:20:26.039> kind<00:20:26.220> of<00:20:26.280> like<00:20:26.280> a 00:20:26.450 --> 00:20:26.460 align:start position:0% PPO right so our agent is kind of like a 00:20:26.460 --> 00:20:28.370 align:start position:0% PPO right so our agent is kind of like a dominating<00:20:26.760> and<00:20:27.120> it's<00:20:27.600> kind<00:20:27.720> of<00:20:27.840> interesting 00:20:28.370 --> 00:20:28.380 align:start position:0% dominating and it's kind of interesting 00:20:28.380 --> 00:20:29.990 align:start position:0% dominating and it's kind of interesting to<00:20:28.559> observe<00:20:28.919> that<00:20:29.100> it's<00:20:29.460> serving<00:20:29.820> less 00:20:29.990 --> 00:20:30.000 align:start position:0% to observe that it's serving less 00:20:30.000 --> 00:20:32.990 align:start position:0% to observe that it's serving less queries<00:20:30.539> right<00:20:30.840> the<00:20:31.200> the<00:20:31.440> blue<00:20:31.740> or<00:20:32.160> CN<00:20:32.580> line<00:20:32.760> is 00:20:32.990 --> 00:20:33.000 align:start position:0% queries right the the blue or CN line is 00:20:33.000 --> 00:20:34.850 align:start position:0% queries right the the blue or CN line is clearly<00:20:33.360> below<00:20:33.720> and<00:20:34.200> this<00:20:34.320> is<00:20:34.440> the<00:20:34.559> number<00:20:34.740> of 00:20:34.850 --> 00:20:34.860 align:start position:0% clearly below and this is the number of 00:20:34.860 --> 00:20:36.890 align:start position:0% clearly below and this is the number of queries<00:20:35.400> that<00:20:35.520> are<00:20:35.700> served<00:20:36.059> but 00:20:36.890 --> 00:20:36.900 align:start position:0% queries that are served but 00:20:36.900 --> 00:20:39.409 align:start position:0% queries that are served but but<00:20:37.020> it's<00:20:37.260> making<00:20:37.500> bigger<00:20:37.980> Revenue<00:20:38.280> right<00:20:38.820> so 00:20:39.409 --> 00:20:39.419 align:start position:0% but it's making bigger Revenue right so 00:20:39.419 --> 00:20:40.789 align:start position:0% but it's making bigger Revenue right so in<00:20:39.720> short 00:20:40.789 --> 00:20:40.799 align:start position:0% in short 00:20:40.799 --> 00:20:43.850 align:start position:0% in short is<00:20:41.100> making<00:20:41.280> less<00:20:41.580> work<00:20:42.299> for<00:20:42.720> more<00:20:42.960> money 00:20:43.850 --> 00:20:43.860 align:start position:0% is making less work for more money 00:20:43.860 --> 00:20:48.470 align:start position:0% is making less work for more money so<00:20:44.100> policy<00:20:44.940> really<00:20:45.360> matters<00:20:45.720> right 00:20:48.470 --> 00:20:48.480 align:start position:0% 00:20:48.480 --> 00:20:50.630 align:start position:0% all<00:20:49.080> right<00:20:49.260> so 00:20:50.630 --> 00:20:50.640 align:start position:0% all right so 00:20:50.640 --> 00:20:52.730 align:start position:0% all right so having<00:20:51.179> those<00:20:51.539> results<00:20:51.780> we<00:20:52.140> are<00:20:52.260> quite<00:20:52.440> quite 00:20:52.730 --> 00:20:52.740 align:start position:0% having those results we are quite quite 00:20:52.740 --> 00:20:54.950 align:start position:0% having those results we are quite quite happy<00:20:52.860> with<00:20:53.160> with<00:20:53.340> those<00:20:53.940> we<00:20:54.299> said<00:20:54.480> okay<00:20:54.660> so 00:20:54.950 --> 00:20:54.960 align:start position:0% happy with with those we said okay so 00:20:54.960 --> 00:20:56.450 align:start position:0% happy with with those we said okay so can<00:20:55.140> we<00:20:55.320> deploy<00:20:55.559> that<00:20:55.740> in<00:20:55.919> production<00:20:56.220> and 00:20:56.450 --> 00:20:56.460 align:start position:0% can we deploy that in production and 00:20:56.460 --> 00:20:58.130 align:start position:0% can we deploy that in production and actually<00:20:56.640> that's<00:20:57.059> our<00:20:57.240> solution<00:20:57.600> you<00:20:57.840> know<00:20:57.960> on 00:20:58.130 --> 00:20:58.140 align:start position:0% actually that's our solution you know on 00:20:58.140 --> 00:20:59.390 align:start position:0% actually that's our solution you know on a<00:20:58.320> Battlefield 00:20:59.390 --> 00:20:59.400 align:start position:0% a Battlefield 00:20:59.400 --> 00:21:01.070 align:start position:0% a Battlefield so<00:20:59.880> once<00:21:00.240> again<00:21:00.299> there's<00:21:00.660> there<00:21:00.840> are<00:21:01.020> many 00:21:01.070 --> 00:21:01.080 align:start position:0% so once again there's there are many 00:21:01.080 --> 00:21:03.350 align:start position:0% so once again there's there are many there<00:21:01.380> are<00:21:01.500> many<00:21:01.620> things<00:21:01.860> to<00:21:02.160> unfold<00:21:02.580> in<00:21:02.820> here 00:21:03.350 --> 00:21:03.360 align:start position:0% there are many things to unfold in here 00:21:03.360 --> 00:21:06.710 align:start position:0% there are many things to unfold in here so<00:21:04.080> let<00:21:04.620> me<00:21:04.740> try<00:21:04.980> to<00:21:05.160> focus<00:21:05.460> on<00:21:05.640> one<00:21:06.240> thing<00:21:06.419> at<00:21:06.539> a 00:21:06.710 --> 00:21:06.720 align:start position:0% so let me try to focus on one thing at a 00:21:06.720 --> 00:21:09.110 align:start position:0% so let me try to focus on one thing at a time<00:21:06.840> right<00:21:07.140> so<00:21:07.740> first<00:21:07.980> this<00:21:08.400> is<00:21:08.520> the<00:21:08.640> mean<00:21:08.820> so 00:21:09.110 --> 00:21:09.120 align:start position:0% time right so first this is the mean so 00:21:09.120 --> 00:21:10.610 align:start position:0% time right so first this is the mean so this<00:21:09.299> is<00:21:09.360> gonna<00:21:09.539> go<00:21:09.720> where<00:21:09.960> the<00:21:10.080> gaussian<00:21:10.440> is 00:21:10.610 --> 00:21:10.620 align:start position:0% this is gonna go where the gaussian is 00:21:10.620 --> 00:21:13.250 align:start position:0% this is gonna go where the gaussian is on<00:21:10.799> that<00:21:10.919> on<00:21:11.160> that<00:21:11.400> x-axis<00:21:12.360> right<00:21:12.600> so<00:21:13.080> what 00:21:13.250 --> 00:21:13.260 align:start position:0% on that on that x-axis right so what 00:21:13.260 --> 00:21:14.870 align:start position:0% on that on that x-axis right so what happens<00:21:13.440> is<00:21:13.679> that<00:21:13.980> the<00:21:14.160> initial<00:21:14.400> value<00:21:14.640> was 00:21:14.870 --> 00:21:14.880 align:start position:0% happens is that the initial value was 00:21:14.880 --> 00:21:17.090 align:start position:0% happens is that the initial value was too<00:21:15.059> high<00:21:15.240> so<00:21:15.900> the<00:21:16.140> mean<00:21:16.260> was<00:21:16.559> going<00:21:16.799> down 00:21:17.090 --> 00:21:17.100 align:start position:0% too high so the mean was going down 00:21:17.100 --> 00:21:19.190 align:start position:0% too high so the mean was going down first<00:21:17.400> but<00:21:17.700> then<00:21:17.940> insteadly<00:21:18.539> it<00:21:18.600> was<00:21:18.780> going<00:21:18.960> up 00:21:19.190 --> 00:21:19.200 align:start position:0% first but then insteadly it was going up 00:21:19.200 --> 00:21:22.490 align:start position:0% first but then insteadly it was going up up<00:21:19.380> good<00:21:20.280> so<00:21:20.520> it<00:21:20.700> was<00:21:20.820> moving<00:21:21.179> to<00:21:21.299> the<00:21:21.480> right<00:21:21.600> at 00:21:22.490 --> 00:21:22.500 align:start position:0% up good so it was moving to the right at 00:21:22.500 --> 00:21:24.950 align:start position:0% up good so it was moving to the right at the<00:21:22.679> same<00:21:22.799> time<00:21:22.980> variance<00:21:23.640> was<00:21:24.299> steady<00:21:24.660> going 00:21:24.950 --> 00:21:24.960 align:start position:0% the same time variance was steady going 00:21:24.960 --> 00:21:26.510 align:start position:0% the same time variance was steady going down<00:21:25.200> which<00:21:25.500> was<00:21:25.679> which<00:21:26.039> means<00:21:26.220> that<00:21:26.340> the 00:21:26.510 --> 00:21:26.520 align:start position:0% down which was which means that the 00:21:26.520 --> 00:21:28.490 align:start position:0% down which was which means that the gyrogen<00:21:27.000> was<00:21:27.240> more<00:21:27.480> and<00:21:27.600> more<00:21:27.780> narrower<00:21:28.200> which 00:21:28.490 --> 00:21:28.500 align:start position:0% gyrogen was more and more narrower which 00:21:28.500 --> 00:21:30.529 align:start position:0% gyrogen was more and more narrower which means<00:21:28.679> that<00:21:28.799> I<00:21:28.980> just<00:21:29.159> were<00:21:29.340> like<00:21:29.460> okay<00:21:29.700> I'm<00:21:30.360> I 00:21:30.529 --> 00:21:30.539 align:start position:0% means that I just were like okay I'm I 00:21:30.539 --> 00:21:32.510 align:start position:0% means that I just were like okay I'm I think<00:21:30.720> I'm<00:21:30.900> there<00:21:31.260> and<00:21:31.559> I'm<00:21:31.919> good<00:21:32.100> right<00:21:32.280> I'm 00:21:32.510 --> 00:21:32.520 align:start position:0% think I'm there and I'm good right I'm 00:21:32.520 --> 00:21:34.070 align:start position:0% think I'm there and I'm good right I'm more<00:21:32.700> confident<00:21:33.000> that<00:21:33.240> I<00:21:33.480> should<00:21:33.600> sample<00:21:33.960> from 00:21:34.070 --> 00:21:34.080 align:start position:0% more confident that I should sample from 00:21:34.080 --> 00:21:37.370 align:start position:0% more confident that I should sample from that<00:21:34.320> our<00:21:34.980> smaller<00:21:35.520> distribution 00:21:37.370 --> 00:21:37.380 align:start position:0% that our smaller distribution 00:21:37.380 --> 00:21:40.850 align:start position:0% that our smaller distribution so<00:21:38.280> the<00:21:39.000> outcome<00:21:39.360> is<00:21:40.020> that<00:21:40.140> the<00:21:40.260> reward<00:21:40.500> goes 00:21:40.850 --> 00:21:40.860 align:start position:0% so the outcome is that the reward goes 00:21:40.860 --> 00:21:42.470 align:start position:0% so the outcome is that the reward goes up<00:21:40.980> maybe<00:21:41.220> you<00:21:41.460> cannot<00:21:41.700> see<00:21:41.820> it<00:21:42.000> in<00:21:42.059> here<00:21:42.240> like 00:21:42.470 --> 00:21:42.480 align:start position:0% up maybe you cannot see it in here like 00:21:42.480 --> 00:21:44.990 align:start position:0% up maybe you cannot see it in here like super<00:21:42.900> nicely<00:21:43.380> but<00:21:43.799> that's<00:21:44.460> the<00:21:44.700> revenue 00:21:44.990 --> 00:21:45.000 align:start position:0% super nicely but that's the revenue 00:21:45.000 --> 00:21:46.789 align:start position:0% super nicely but that's the revenue right<00:21:45.299> that's<00:21:45.480> the<00:21:45.720> total<00:21:45.960> revenue<00:21:46.260> and<00:21:46.620> you 00:21:46.789 --> 00:21:46.799 align:start position:0% right that's the total revenue and you 00:21:46.799 --> 00:21:47.810 align:start position:0% right that's the total revenue and you can<00:21:46.919> clearly 00:21:47.810 --> 00:21:47.820 align:start position:0% can clearly 00:21:47.820 --> 00:21:49.909 align:start position:0% can clearly see<00:21:48.360> that<00:21:48.600> it's<00:21:48.840> it's<00:21:49.020> going<00:21:49.260> up<00:21:49.500> there<00:21:49.679> is<00:21:49.860> the 00:21:49.909 --> 00:21:49.919 align:start position:0% see that it's it's going up there is the 00:21:49.919 --> 00:21:51.169 align:start position:0% see that it's it's going up there is the tendency<00:21:50.280> right 00:21:51.169 --> 00:21:51.179 align:start position:0% tendency right 00:21:51.179 --> 00:21:53.630 align:start position:0% tendency right so<00:21:51.780> we<00:21:52.500> deploy<00:21:52.860> that 00:21:53.630 --> 00:21:53.640 align:start position:0% so we deploy that 00:21:53.640 --> 00:21:57.590 align:start position:0% so we deploy that the<00:21:54.120> results<00:21:54.360> were<00:21:54.840> great<00:21:55.400> so<00:21:56.400> I<00:21:57.059> think<00:21:57.179> we<00:21:57.419> are 00:21:57.590 --> 00:21:57.600 align:start position:0% the results were great so I think we are 00:21:57.600 --> 00:21:59.390 align:start position:0% the results were great so I think we are well<00:21:58.200> this<00:21:58.500> is<00:21:58.559> the<00:21:58.620> amount<00:21:58.860> where<00:21:59.039> I<00:21:59.220> should 00:21:59.390 --> 00:21:59.400 align:start position:0% well this is the amount where I should 00:21:59.400 --> 00:22:01.430 align:start position:0% well this is the amount where I should start<00:21:59.880> telling<00:22:00.299> okay<00:22:00.480> if<00:22:00.720> you're<00:22:00.840> an<00:22:01.020> indexer 00:22:01.430 --> 00:22:01.440 align:start position:0% start telling okay if you're an indexer 00:22:01.440 --> 00:22:04.070 align:start position:0% start telling okay if you're an indexer please<00:22:02.039> go<00:22:02.280> ahead<00:22:02.520> there's<00:22:03.179> a<00:22:03.360> repository<00:22:03.840> to 00:22:04.070 --> 00:22:04.080 align:start position:0% please go ahead there's a repository to 00:22:04.080 --> 00:22:07.010 align:start position:0% please go ahead there's a repository to download<00:22:04.200> play<00:22:04.860> with<00:22:05.159> it<00:22:05.340> and<00:22:06.240> we<00:22:06.480> there<00:22:06.840> are 00:22:07.010 --> 00:22:07.020 align:start position:0% download play with it and we there are 00:22:07.020 --> 00:22:08.870 align:start position:0% download play with it and we there are some<00:22:07.140> additional<00:22:07.620> materials<00:22:08.100> okay<00:22:08.340> but<00:22:08.640> you 00:22:08.870 --> 00:22:08.880 align:start position:0% some additional materials okay but you 00:22:08.880 --> 00:22:10.430 align:start position:0% some additional materials okay but you know<00:22:09.000> actually<00:22:09.240> in<00:22:09.539> a<00:22:09.659> second<00:22:09.780> okay<00:22:09.960> so<00:22:10.140> let<00:22:10.260> me 00:22:10.430 --> 00:22:10.440 align:start position:0% know actually in a second okay so let me 00:22:10.440 --> 00:22:12.710 align:start position:0% know actually in a second okay so let me first<00:22:10.559> summarize<00:22:10.980> so<00:22:11.700> agent<00:22:12.059> based<00:22:12.419> modeling 00:22:12.710 --> 00:22:12.720 align:start position:0% first summarize so agent based modeling 00:22:12.720 --> 00:22:14.570 align:start position:0% first summarize so agent based modeling for<00:22:12.960> crypto<00:22:13.260> economics<00:22:13.799> that<00:22:14.039> was<00:22:14.220> the<00:22:14.460> core 00:22:14.570 --> 00:22:14.580 align:start position:0% for crypto economics that was the core 00:22:14.580 --> 00:22:17.029 align:start position:0% for crypto economics that was the core of<00:22:14.820> that<00:22:14.940> talk<00:22:15.179> and<00:22:15.780> in<00:22:16.140> here<00:22:16.320> is<00:22:16.500> focus<00:22:16.740> we 00:22:17.029 --> 00:22:17.039 align:start position:0% of that talk and in here is focus we 00:22:17.039 --> 00:22:19.310 align:start position:0% of that talk and in here is focus we focus<00:22:17.280> on<00:22:17.520> the<00:22:17.640> diamond<00:22:17.880> Dynamic<00:22:18.480> pricing<00:22:18.840> for 00:22:19.310 --> 00:22:19.320 align:start position:0% focus on the diamond Dynamic pricing for 00:22:19.320 --> 00:22:22.310 align:start position:0% focus on the diamond Dynamic pricing for the<00:22:19.559> applied<00:22:19.980> to<00:22:20.159> the<00:22:20.760> graph<00:22:21.000> protocol<00:22:21.360> to<00:22:22.140> to 00:22:22.310 --> 00:22:22.320 align:start position:0% the applied to the graph protocol to to 00:22:22.320 --> 00:22:24.950 align:start position:0% the applied to the graph protocol to to automated<00:22:22.860> price<00:22:23.280> Discovery<00:22:23.880> and<00:22:24.600> we<00:22:24.780> use 00:22:24.950 --> 00:22:24.960 align:start position:0% automated price Discovery and we use 00:22:24.960 --> 00:22:27.350 align:start position:0% automated price Discovery and we use reinforcement<00:22:25.500> learning<00:22:25.919> and<00:22:26.159> and<00:22:26.360> a 00:22:27.350 --> 00:22:27.360 align:start position:0% reinforcement learning and and a 00:22:27.360 --> 00:22:28.390 align:start position:0% reinforcement learning and and a multiple 00:22:28.390 --> 00:22:28.400 align:start position:0% multiple 00:22:28.400 --> 00:22:30.529 align:start position:0% multiple multi-agent<00:22:29.400> simulation<00:22:29.940> multi-agent 00:22:30.529 --> 00:22:30.539 align:start position:0% multi-agent simulation multi-agent 00:22:30.539 --> 00:22:32.870 align:start position:0% multi-agent simulation multi-agent modeling<00:22:30.900> for<00:22:31.080> for<00:22:31.440> Revenue<00:22:31.740> maximization<00:22:32.340> so 00:22:32.870 --> 00:22:32.880 align:start position:0% modeling for for Revenue maximization so 00:22:32.880 --> 00:22:35.149 align:start position:0% modeling for for Revenue maximization so we<00:22:33.000> can<00:22:33.120> show<00:22:33.299> how<00:22:33.539> to<00:22:33.659> use<00:22:33.900> that<00:22:34.140> for<00:22:34.380> testing 00:22:35.149 --> 00:22:35.159 align:start position:0% we can show how to use that for testing 00:22:35.159 --> 00:22:36.890 align:start position:0% we can show how to use that for testing the<00:22:35.340> properties<00:22:35.700> of<00:22:35.880> the<00:22:36.000> protocol<00:22:36.299> right<00:22:36.659> we 00:22:36.890 --> 00:22:36.900 align:start position:0% the properties of the protocol right we 00:22:36.900 --> 00:22:38.390 align:start position:0% the properties of the protocol right we came<00:22:37.020> with<00:22:37.140> that<00:22:37.380> framework<00:22:37.740> that<00:22:37.919> okay<00:22:38.100> those 00:22:38.390 --> 00:22:38.400 align:start position:0% came with that framework that okay those 00:22:38.400 --> 00:22:40.190 align:start position:0% came with that framework that okay those are<00:22:38.580> the<00:22:38.700> market<00:22:38.880> conditions<00:22:39.419> those<00:22:39.900> are<00:22:40.020> the 00:22:40.190 --> 00:22:40.200 align:start position:0% are the market conditions those are the 00:22:40.200 --> 00:22:42.529 align:start position:0% are the market conditions those are the properties<00:22:40.620> and<00:22:41.280> systematically<00:22:42.059> start<00:22:42.360> the 00:22:42.529 --> 00:22:42.539 align:start position:0% properties and systematically start the 00:22:42.539 --> 00:22:45.169 align:start position:0% properties and systematically start the test<00:22:42.780> right<00:22:43.260> uh<00:22:44.100> our<00:22:44.340> our<00:22:44.640> agents<00:22:45.059> are 00:22:45.169 --> 00:22:45.179 align:start position:0% test right uh our our agents are 00:22:45.179 --> 00:22:47.149 align:start position:0% test right uh our our agents are solutions<00:22:45.539> against<00:22:45.780> against<00:22:46.260> those<00:22:46.679> and 00:22:47.149 --> 00:22:47.159 align:start position:0% solutions against against those and 00:22:47.159 --> 00:22:49.070 align:start position:0% solutions against against those and finally<00:22:47.340> we<00:22:47.460> have<00:22:47.580> deployed<00:22:48.000> out<00:22:48.120> our<00:22:48.240> in<00:22:48.960> in 00:22:49.070 --> 00:22:49.080 align:start position:0% finally we have deployed out our in in 00:22:49.080 --> 00:22:51.529 align:start position:0% finally we have deployed out our in in in<00:22:49.559> production<00:22:50.100> and<00:22:50.400> have<00:22:50.760> shown<00:22:51.360> that 00:22:51.529 --> 00:22:51.539 align:start position:0% in production and have shown that 00:22:51.539 --> 00:22:55.250 align:start position:0% in production and have shown that actually<00:22:52.140> it<00:22:52.440> makes<00:22:52.919> sense<00:22:53.419> so<00:22:54.419> Future<00:22:54.659> Works 00:22:55.250 --> 00:22:55.260 align:start position:0% actually it makes sense so Future Works 00:22:55.260 --> 00:22:57.770 align:start position:0% actually it makes sense so Future Works of<00:22:55.559> course<00:22:55.679> better<00:22:55.980> policy<00:22:56.880> better<00:22:57.299> updates 00:22:57.770 --> 00:22:57.780 align:start position:0% of course better policy better updates 00:22:57.780 --> 00:23:00.169 align:start position:0% of course better policy better updates better<00:22:58.260> policies<00:22:58.860> agents<00:22:59.700> of<00:22:59.760> multiple 00:23:00.169 --> 00:23:00.179 align:start position:0% better policies agents of multiple 00:23:00.179 --> 00:23:01.970 align:start position:0% better policies agents of multiple rewards<00:23:00.659> of<00:23:00.900> taking<00:23:01.140> quality<00:23:01.679> of<00:23:01.799> service 00:23:01.970 --> 00:23:01.980 align:start position:0% rewards of taking quality of service 00:23:01.980 --> 00:23:03.710 align:start position:0% rewards of taking quality of service into<00:23:02.280> account<00:23:02.580> we<00:23:02.880> are<00:23:03.059> not<00:23:03.179> doing<00:23:03.299> that<00:23:03.539> right 00:23:03.710 --> 00:23:03.720 align:start position:0% into account we are not doing that right 00:23:03.720 --> 00:23:07.310 align:start position:0% into account we are not doing that right now<00:23:03.840> just<00:23:04.080> we<00:23:04.380> are<00:23:04.559> just<00:23:05.240> looking<00:23:06.240> at<00:23:06.480> the<00:23:06.960> at 00:23:07.310 --> 00:23:07.320 align:start position:0% now just we are just looking at the at 00:23:07.320 --> 00:23:10.850 align:start position:0% now just we are just looking at the at the<00:23:07.559> query<00:23:07.740> volume<00:23:07.980> uh<00:23:09.419> modeling<00:23:10.320> and<00:23:10.559> putting 00:23:10.850 --> 00:23:10.860 align:start position:0% the query volume uh modeling and putting 00:23:10.860 --> 00:23:12.649 align:start position:0% the query volume uh modeling and putting consumer<00:23:11.220> agents<00:23:11.580> into<00:23:11.700> play<00:23:12.000> right<00:23:12.240> so<00:23:12.480> that 00:23:12.649 --> 00:23:12.659 align:start position:0% consumer agents into play right so that 00:23:12.659 --> 00:23:14.090 align:start position:0% consumer agents into play right so that right<00:23:12.900> hand<00:23:13.020> side<00:23:13.200> that<00:23:13.440> we<00:23:13.620> simply<00:23:13.919> fight 00:23:14.090 --> 00:23:14.100 align:start position:0% right hand side that we simply fight 00:23:14.100 --> 00:23:15.950 align:start position:0% right hand side that we simply fight actually<00:23:14.340> putting<00:23:14.880> that<00:23:15.059> back<00:23:15.659> in<00:23:15.840> the 00:23:15.950 --> 00:23:15.960 align:start position:0% actually putting that back in the 00:23:15.960 --> 00:23:18.470 align:start position:0% actually putting that back in the simulation<00:23:16.460> it<00:23:17.460> will<00:23:17.700> give<00:23:18.000> us<00:23:18.179> some<00:23:18.299> more 00:23:18.470 --> 00:23:18.480 align:start position:0% simulation it will give us some more 00:23:18.480 --> 00:23:20.270 align:start position:0% simulation it will give us some more insight<00:23:18.780> in<00:23:18.960> what<00:23:19.140> is<00:23:19.500> happening<00:23:19.799> right<00:23:20.039> so 00:23:20.270 --> 00:23:20.280 align:start position:0% insight in what is happening right so 00:23:20.280 --> 00:23:21.649 align:start position:0% insight in what is happening right so that's<00:23:20.400> kind<00:23:20.640> of<00:23:20.760> that<00:23:21.240> will<00:23:21.360> give<00:23:21.480> a 00:23:21.649 --> 00:23:21.659 align:start position:0% that's kind of that will give a 00:23:21.659 --> 00:23:24.110 align:start position:0% that's kind of that will give a simulator<00:23:21.900> with<00:23:22.260> higher<00:23:22.679> Fidelity<00:23:23.120> and 00:23:24.110 --> 00:23:24.120 align:start position:0% simulator with higher Fidelity and 00:23:24.120 --> 00:23:25.730 align:start position:0% simulator with higher Fidelity and uncomfortable<00:23:24.720> redesigning<00:23:25.320> the<00:23:25.440> game<00:23:25.620> right 00:23:25.730 --> 00:23:25.740 align:start position:0% uncomfortable redesigning the game right 00:23:25.740 --> 00:23:27.230 align:start position:0% uncomfortable redesigning the game right so<00:23:25.980> in<00:23:26.100> this<00:23:26.220> case<00:23:26.400> there<00:23:26.700> was<00:23:26.820> no<00:23:27.059> information 00:23:27.230 --> 00:23:27.240 align:start position:0% so in this case there was no information 00:23:27.240 --> 00:23:29.870 align:start position:0% so in this case there was no information the<00:23:27.720> agents<00:23:28.260> were<00:23:28.380> like<00:23:28.620> acting<00:23:29.460> totally 00:23:29.870 --> 00:23:29.880 align:start position:0% the agents were like acting totally 00:23:29.880 --> 00:23:31.430 align:start position:0% the agents were like acting totally independently<00:23:30.360> the<00:23:30.539> questions<00:23:30.720> it<00:23:31.260> will 00:23:31.430 --> 00:23:31.440 align:start position:0% independently the questions it will 00:23:31.440 --> 00:23:33.169 align:start position:0% independently the questions it will redesign<00:23:31.980> the<00:23:32.159> game<00:23:32.280> redesign<00:23:32.820> a<00:23:33.000> little<00:23:33.059> bit 00:23:33.169 --> 00:23:33.179 align:start position:0% redesign the game redesign a little bit 00:23:33.179 --> 00:23:35.630 align:start position:0% redesign the game redesign a little bit the<00:23:33.360> graph<00:23:33.720> protocol<00:23:34.020> would<00:23:34.860> that<00:23:35.159> kind<00:23:35.460> of 00:23:35.630 --> 00:23:35.640 align:start position:0% the graph protocol would that kind of 00:23:35.640 --> 00:23:37.250 align:start position:0% the graph protocol would that kind of perfect<00:23:35.940> information<00:23:36.240> will<00:23:36.659> help<00:23:36.960> right 00:23:37.250 --> 00:23:37.260 align:start position:0% perfect information will help right 00:23:37.260 --> 00:23:38.990 align:start position:0% perfect information will help right there<00:23:37.980> are<00:23:38.100> some<00:23:38.220> here<00:23:38.400> are<00:23:38.580> some<00:23:38.700> additional 00:23:38.990 --> 00:23:39.000 align:start position:0% there are some here are some additional 00:23:39.000 --> 00:23:42.350 align:start position:0% there are some here are some additional resources<00:23:39.480> so<00:23:39.919> my<00:23:40.919> friend<00:23:41.039> Alex<00:23:41.220> is<00:23:41.580> he<00:23:41.820> there 00:23:42.350 --> 00:23:42.360 align:start position:0% resources so my friend Alex is he there 00:23:42.360 --> 00:23:43.789 align:start position:0% resources so my friend Alex is he there is<00:23:42.539> he<00:23:42.780> wrote<00:23:42.960> this<00:23:43.140> blog<00:23:43.380> post<00:23:43.500> which 00:23:43.789 --> 00:23:43.799 align:start position:0% is he wrote this blog post which 00:23:43.799 --> 00:23:45.710 align:start position:0% is he wrote this blog post which describes<00:23:44.340> more<00:23:44.520> the<00:23:44.820> technical<00:23:45.240> side<00:23:45.419> of 00:23:45.710 --> 00:23:45.720 align:start position:0% describes more the technical side of 00:23:45.720 --> 00:23:47.990 align:start position:0% describes more the technical side of deploying<00:23:46.260> our<00:23:46.620> Target<00:23:46.860> in<00:23:47.220> production<00:23:47.520> he 00:23:47.990 --> 00:23:48.000 align:start position:0% deploying our Target in production he 00:23:48.000 --> 00:23:50.390 align:start position:0% deploying our Target in production he also<00:23:48.240> gave<00:23:48.419> a<00:23:48.600> talk<00:23:48.780> around<00:23:49.020> this<00:23:49.320> about<00:23:50.039> this 00:23:50.390 --> 00:23:50.400 align:start position:0% also gave a talk around this about this 00:23:50.400 --> 00:23:54.470 align:start position:0% also gave a talk around this about this during<00:23:50.700> the<00:23:51.000> last<00:23:51.360> track<00:23:51.840> episode<00:23:52.820> in<00:23:53.820> June<00:23:54.360> I 00:23:54.470 --> 00:23:54.480 align:start position:0% during the last track episode in June I 00:23:54.480 --> 00:23:56.450 align:start position:0% during the last track episode in June I think<00:23:55.020> so<00:23:55.440> there's<00:23:55.620> a<00:23:55.799> recording<00:23:56.159> on<00:23:56.280> YouTube 00:23:56.450 --> 00:23:56.460 align:start position:0% think so there's a recording on YouTube 00:23:56.460 --> 00:23:59.570 align:start position:0% think so there's a recording on YouTube and<00:23:56.760> of<00:23:56.880> course<00:23:57.000> this<00:23:57.360> is<00:23:57.480> open<00:23:57.659> source<00:23:58.140> so<00:23:58.980> I 00:23:59.570 --> 00:23:59.580 align:start position:0% and of course this is open source so I 00:23:59.580 --> 00:24:01.370 align:start position:0% and of course this is open source so I encourage<00:23:59.940> you<00:24:00.059> go<00:24:00.480> ahead<00:24:00.720> play<00:24:01.020> with<00:24:01.200> it 00:24:01.370 --> 00:24:01.380 align:start position:0% encourage you go ahead play with it 00:24:01.380 --> 00:24:03.770 align:start position:0% encourage you go ahead play with it write<00:24:02.039> all<00:24:02.280> those<00:24:02.400> visualizations<00:24:03.120> are<00:24:03.480> there 00:24:03.770 --> 00:24:03.780 align:start position:0% write all those visualizations are there 00:24:03.780 --> 00:24:06.110 align:start position:0% write all those visualizations are there basic<00:24:04.740> you<00:24:04.860> can<00:24:04.980> reproduce<00:24:05.400> that<00:24:05.520> and<00:24:05.700> try<00:24:05.940> to 00:24:06.110 --> 00:24:06.120 align:start position:0% basic you can reproduce that and try to 00:24:06.120 --> 00:24:08.750 align:start position:0% basic you can reproduce that and try to deploy<00:24:06.480> your<00:24:06.600> your<00:24:07.320> your<00:24:07.740> altarger<00:24:08.580> in 00:24:08.750 --> 00:24:08.760 align:start position:0% deploy your your your altarger in 00:24:08.760 --> 00:24:11.330 align:start position:0% deploy your your your altarger in production<00:24:09.059> right<00:24:09.559> uh<00:24:10.559> finally<00:24:10.860> I<00:24:11.039> wanted<00:24:11.159> to 00:24:11.330 --> 00:24:11.340 align:start position:0% production right uh finally I wanted to 00:24:11.340 --> 00:24:12.890 align:start position:0% production right uh finally I wanted to highlight<00:24:11.640> some<00:24:11.880> of<00:24:12.000> the<00:24:12.120> of<00:24:12.360> the<00:24:12.539> other<00:24:12.659> words 00:24:12.890 --> 00:24:12.900 align:start position:0% highlight some of the of the other words 00:24:12.900 --> 00:24:14.750 align:start position:0% highlight some of the of the other words that<00:24:13.200> samiotic<00:24:13.679> is<00:24:13.799> doing<00:24:13.919> so<00:24:14.159> their<00:24:14.520> stock 00:24:14.750 --> 00:24:14.760 align:start position:0% that samiotic is doing so their stock 00:24:14.760 --> 00:24:16.730 align:start position:0% that samiotic is doing so their stock actually<00:24:15.179> that's<00:24:15.600> happened<00:24:15.780> right<00:24:16.140> now<00:24:16.320> that 00:24:16.730 --> 00:24:16.740 align:start position:0% actually that's happened right now that 00:24:16.740 --> 00:24:18.649 align:start position:0% actually that's happened right now that that<00:24:16.980> our<00:24:17.220> friend<00:24:17.400> Matt<00:24:17.640> is<00:24:17.880> giving<00:24:18.120> his<00:24:18.360> the 00:24:18.649 --> 00:24:18.659 align:start position:0% that our friend Matt is giving his the 00:24:18.659 --> 00:24:20.930 align:start position:0% that our friend Matt is giving his the product<00:24:19.080> and<00:24:19.740> research<00:24:20.100> data<00:24:20.460> for<00:24:20.580> us<00:24:20.760> he's 00:24:20.930 --> 00:24:20.940 align:start position:0% product and research data for us he's 00:24:20.940 --> 00:24:23.390 align:start position:0% product and research data for us he's giving<00:24:21.240> it<00:24:21.419> right<00:24:21.600> now<00:24:21.840> so<00:24:22.440> that's<00:24:22.919> uh<00:24:23.159> that's 00:24:23.390 --> 00:24:23.400 align:start position:0% giving it right now so that's uh that's 00:24:23.400 --> 00:24:26.330 align:start position:0% giving it right now so that's uh that's that<00:24:23.580> said<00:24:23.880> and<00:24:24.539> Savvy<00:24:25.020> is<00:24:25.620> giving<00:24:25.860> a<00:24:26.220> talk 00:24:26.330 --> 00:24:26.340 align:start position:0% that said and Savvy is giving a talk 00:24:26.340 --> 00:24:28.730 align:start position:0% that said and Savvy is giving a talk today<00:24:26.580> about<00:24:27.000> our<00:24:27.600> work<00:24:27.840> and<00:24:28.080> or<00:24:28.320> let's<00:24:28.559> say 00:24:28.730 --> 00:24:28.740 align:start position:0% today about our work and or let's say 00:24:28.740 --> 00:24:32.149 align:start position:0% today about our work and or let's say our<00:24:28.980> our<00:24:29.280> our<00:24:29.580> our<00:24:29.820> our<00:24:29.940> our<00:24:30.299> our<00:24:30.780> trip<00:24:31.320> in<00:24:32.039> the 00:24:32.149 --> 00:24:32.159 align:start position:0% our our our our our our our trip in the 00:24:32.159 --> 00:24:34.130 align:start position:0% our our our our our our our trip in the to<00:24:32.340> the<00:24:32.460> snarks<00:24:32.880> world<00:24:33.059> and<00:24:33.419> we<00:24:33.600> are<00:24:33.780> focusing 00:24:34.130 --> 00:24:34.140 align:start position:0% to the snarks world and we are focusing 00:24:34.140 --> 00:24:37.310 align:start position:0% to the snarks world and we are focusing on<00:24:34.320> on<00:24:34.559> this<00:24:35.340> is<00:24:35.460> more<00:24:35.700> like<00:24:35.820> cryptography<00:24:36.659> uh 00:24:37.310 --> 00:24:37.320 align:start position:0% on on this is more like cryptography uh 00:24:37.320 --> 00:24:39.049 align:start position:0% on on this is more like cryptography uh we<00:24:37.500> are<00:24:37.679> focusing<00:24:38.039> on<00:24:38.220> verifiable<00:24:38.760> payments 00:24:39.049 --> 00:24:39.059 align:start position:0% we are focusing on verifiable payments 00:24:39.059 --> 00:24:42.529 align:start position:0% we are focusing on verifiable payments for<00:24:39.360> the<00:24:39.539> graph<00:24:39.780> protocol<00:24:40.200> as<00:24:40.500> well<00:24:41.059> so<00:24:42.059> if 00:24:42.529 --> 00:24:42.539 align:start position:0% for the graph protocol as well so if 00:24:42.539 --> 00:24:44.870 align:start position:0% for the graph protocol as well so if you're<00:24:42.780> interested<00:24:43.140> in<00:24:43.320> those<00:24:43.500> those<00:24:43.919> topics 00:24:44.870 --> 00:24:44.880 align:start position:0% you're interested in those those topics 00:24:44.880 --> 00:24:47.810 align:start position:0% you're interested in those those topics please<00:24:45.299> come<00:24:45.659> to<00:24:45.840> us<00:24:46.020> we've<00:24:46.980> got<00:24:47.100> plenty<00:24:47.700> of 00:24:47.810 --> 00:24:47.820 align:start position:0% please come to us we've got plenty of 00:24:47.820 --> 00:24:50.870 align:start position:0% please come to us we've got plenty of positions<00:24:48.480> open<00:24:48.720> we<00:24:49.500> if<00:24:50.220> you're<00:24:50.340> interested 00:24:50.870 --> 00:24:50.880 align:start position:0% positions open we if you're interested 00:24:50.880 --> 00:24:52.010 align:start position:0% positions open we if you're interested please<00:24:51.059> go<00:24:51.299> ahead 00:24:52.010 --> 00:24:52.020 align:start position:0% please go ahead 00:24:52.020 --> 00:25:08.390 align:start position:0% please go ahead thank<00:24:52.620> you<00:24:52.799> for<00:24:53.760> your<00:24:54.059> information 00:25:08.390 --> 00:25:08.400 align:start position:0% 00:25:08.400 --> 00:25:10.430 align:start position:0% excuse<00:25:08.760> me<00:25:08.880> there's<00:25:09.059> a<00:25:09.299> gentleman<00:25:09.780> who<00:25:10.140> wants 00:25:10.430 --> 00:25:10.440 align:start position:0% excuse me there's a gentleman who wants 00:25:10.440 --> 00:25:11.670 align:start position:0% excuse me there's a gentleman who wants to<00:25:10.559> be<00:25:10.679> back 00:25:11.670 --> 00:25:11.680 align:start position:0% to be back 00:25:11.680 --> 00:25:16.490 align:start position:0% to be back [Music] 00:25:16.490 --> 00:25:16.500 align:start position:0% 00:25:16.500 --> 00:25:18.590 align:start position:0% hello<00:25:16.799> and<00:25:17.159> thank<00:25:17.340> you<00:25:17.460> for<00:25:17.520> the<00:25:17.700> talk<00:25:17.940> I<00:25:18.480> was 00:25:18.590 --> 00:25:18.600 align:start position:0% hello and thank you for the talk I was 00:25:18.600 --> 00:25:21.110 align:start position:0% hello and thank you for the talk I was wondering<00:25:19.020> if<00:25:19.440> the<00:25:19.620> customer<00:25:19.860> has<00:25:20.520> a<00:25:20.940> very 00:25:21.110 --> 00:25:21.120 align:start position:0% wondering if the customer has a very 00:25:21.120 --> 00:25:23.330 align:start position:0% wondering if the customer has a very very<00:25:21.299> low<00:25:21.539> budget<00:25:21.960> will<00:25:22.320> you<00:25:22.559> try<00:25:22.679> to<00:25:22.860> match<00:25:23.039> it 00:25:23.330 --> 00:25:23.340 align:start position:0% very low budget will you try to match it 00:25:23.340 --> 00:25:25.610 align:start position:0% very low budget will you try to match it and<00:25:23.940> make<00:25:24.120> a<00:25:24.299> loss<00:25:24.600> or<00:25:24.779> will<00:25:24.960> you<00:25:25.140> shut<00:25:25.380> down 00:25:25.610 --> 00:25:25.620 align:start position:0% and make a loss or will you shut down 00:25:25.620 --> 00:25:27.409 align:start position:0% and make a loss or will you shut down that's<00:25:26.159> a<00:25:26.400> great<00:25:26.520> question<00:25:26.760> actually<00:25:27.120> I 00:25:27.409 --> 00:25:27.419 align:start position:0% that's a great question actually I 00:25:27.419 --> 00:25:28.850 align:start position:0% that's a great question actually I wasn't<00:25:27.659> showing<00:25:28.140> this<00:25:28.260> in<00:25:28.440> here<00:25:28.620> right 00:25:28.850 --> 00:25:28.860 align:start position:0% wasn't showing this in here right 00:25:28.860 --> 00:25:31.190 align:start position:0% wasn't showing this in here right because<00:25:29.159> it's<00:25:29.460> shaky<00:25:29.940> like<00:25:30.360> I<00:25:30.480> said<00:25:30.600> the<00:25:30.960> goal 00:25:31.190 --> 00:25:31.200 align:start position:0% because it's shaky like I said the goal 00:25:31.200 --> 00:25:34.610 align:start position:0% because it's shaky like I said the goal of<00:25:31.260> graph<00:25:31.679> is<00:25:32.460> to<00:25:32.580> have<00:25:32.760> five<00:25:32.940> nines<00:25:33.779> so<00:25:34.320> right 00:25:34.610 --> 00:25:34.620 align:start position:0% of graph is to have five nines so right 00:25:34.620 --> 00:25:37.070 align:start position:0% of graph is to have five nines so right now<00:25:34.799> we<00:25:35.100> are<00:25:35.340> working<00:25:35.760> with<00:25:36.240> with<00:25:36.539> the<00:25:36.960> guys 00:25:37.070 --> 00:25:37.080 align:start position:0% now we are working with with the guys 00:25:37.080 --> 00:25:38.990 align:start position:0% now we are working with with the guys that<00:25:37.500> are<00:25:37.679> you<00:25:38.039> know<00:25:38.100> implementing<00:25:38.640> the<00:25:38.760> guide 00:25:38.990 --> 00:25:39.000 align:start position:0% that are you know implementing the guide 00:25:39.000 --> 00:25:40.789 align:start position:0% that are you know implementing the guide when<00:25:39.299> updating<00:25:39.900> that<00:25:40.260> a<00:25:40.440> little<00:25:40.500> bit<00:25:40.620> because 00:25:40.789 --> 00:25:40.799 align:start position:0% when updating that a little bit because 00:25:40.799 --> 00:25:43.610 align:start position:0% when updating that a little bit because for<00:25:41.100> now<00:25:41.220> if<00:25:42.059> the<00:25:42.240> customer<00:25:42.419> will<00:25:42.840> say<00:25:43.080> okay 00:25:43.610 --> 00:25:43.620 align:start position:0% for now if the customer will say okay 00:25:43.620 --> 00:25:46.070 align:start position:0% for now if the customer will say okay I'm<00:25:43.980> I<00:25:44.220> want<00:25:44.340> that<00:25:44.520> for<00:25:44.760> basically<00:25:45.120> free<00:25:45.299> the 00:25:46.070 --> 00:25:46.080 align:start position:0% I'm I want that for basically free the 00:25:46.080 --> 00:25:47.630 align:start position:0% I'm I want that for basically free the Gateway<00:25:46.440> will<00:25:46.620> still<00:25:46.860> try<00:25:46.980> to<00:25:47.159> distribute 00:25:47.630 --> 00:25:47.640 align:start position:0% Gateway will still try to distribute 00:25:47.640 --> 00:25:48.590 align:start position:0% Gateway will still try to distribute that 00:25:48.590 --> 00:25:48.600 align:start position:0% that 00:25:48.600 --> 00:25:49.669 align:start position:0% that right 00:25:49.669 --> 00:25:49.679 align:start position:0% right 00:25:49.679 --> 00:25:51.950 align:start position:0% right it's<00:25:50.100> not<00:25:50.279> the<00:25:50.520> best<00:25:50.700> outcome<00:25:51.299> I<00:25:51.720> would<00:25:51.840> say 00:25:51.950 --> 00:25:51.960 align:start position:0% it's not the best outcome I would say 00:25:51.960 --> 00:25:53.690 align:start position:0% it's not the best outcome I would say for<00:25:52.200> the<00:25:52.320> indexers<00:25:52.740> right<00:25:53.100> but<00:25:53.460> we<00:25:53.580> are 00:25:53.690 --> 00:25:53.700 align:start position:0% for the indexers right but we are 00:25:53.700 --> 00:25:54.710 align:start position:0% for the indexers right but we are changing<00:25:54.059> that 00:25:54.710 --> 00:25:54.720 align:start position:0% changing that 00:25:54.720 --> 00:25:57.230 align:start position:0% changing that we<00:25:55.260> are<00:25:55.440> we've<00:25:55.919> got<00:25:56.039> a<00:25:56.220> tool<00:25:56.520> right<00:25:56.640> now<00:25:56.820> right 00:25:57.230 --> 00:25:57.240 align:start position:0% we are we've got a tool right now right 00:25:57.240 --> 00:25:59.149 align:start position:0% we are we've got a tool right now right so<00:25:57.779> you<00:25:57.900> can<00:25:58.020> think<00:25:58.200> about<00:25:58.380> I<00:25:58.679> was<00:25:58.799> showing<00:25:59.100> you 00:25:59.149 --> 00:25:59.159 align:start position:0% so you can think about I was showing you 00:25:59.159 --> 00:26:01.070 align:start position:0% so you can think about I was showing you that<00:25:59.400> no<00:25:59.580> we're<00:26:00.000> working<00:26:00.299> in<00:26:00.600> this<00:26:00.720> work<00:26:00.900> we 00:26:01.070 --> 00:26:01.080 align:start position:0% that no we're working in this work we 00:26:01.080 --> 00:26:03.470 align:start position:0% that no we're working in this work we are<00:26:01.200> focusing<00:26:01.500> on<00:26:01.679> the<00:26:01.980> agents<00:26:02.340> right<00:26:02.520> but<00:26:03.299> we 00:26:03.470 --> 00:26:03.480 align:start position:0% are focusing on the agents right but we 00:26:03.480 --> 00:26:05.149 align:start position:0% are focusing on the agents right but we developed<00:26:03.840> a<00:26:04.020> tool<00:26:04.260> that<00:26:04.320> enables<00:26:04.740> us<00:26:04.860> to<00:26:04.980> test 00:26:05.149 --> 00:26:05.159 align:start position:0% developed a tool that enables us to test 00:26:05.159 --> 00:26:06.710 align:start position:0% developed a tool that enables us to test the<00:26:05.340> properties<00:26:05.700> and<00:26:06.000> the<00:26:06.179> outcome<00:26:06.419> of<00:26:06.539> the 00:26:06.710 --> 00:26:06.720 align:start position:0% the properties and the outcome of the 00:26:06.720 --> 00:26:08.149 align:start position:0% the properties and the outcome of the whole<00:26:06.840> thing<00:26:07.020> right<00:26:07.320> when<00:26:07.860> there<00:26:08.039> are 00:26:08.149 --> 00:26:08.159 align:start position:0% whole thing right when there are 00:26:08.159 --> 00:26:10.070 align:start position:0% whole thing right when there are different<00:26:08.340> players<00:26:09.059> in<00:26:09.240> the<00:26:09.419> game<00:26:09.539> including 00:26:10.070 --> 00:26:10.080 align:start position:0% different players in the game including 00:26:10.080 --> 00:26:13.010 align:start position:0% different players in the game including Gateway<00:26:10.460> so<00:26:11.460> great<00:26:11.820> question 00:26:13.010 --> 00:26:13.020 align:start position:0% Gateway so great question 00:26:13.020 --> 00:26:14.990 align:start position:0% Gateway so great question it's<00:26:13.559> not<00:26:13.799> tricky<00:26:14.100> right<00:26:14.279> the<00:26:14.520> tricky<00:26:14.880> thing 00:26:14.990 --> 00:26:15.000 align:start position:0% it's not tricky right the tricky thing 00:26:15.000 --> 00:26:16.250 align:start position:0% it's not tricky right the tricky thing what<00:26:15.179> do<00:26:15.240> we<00:26:15.360> want<00:26:15.419> to<00:26:15.539> achieve<00:26:15.779> we<00:26:16.020> want<00:26:16.140> the 00:26:16.250 --> 00:26:16.260 align:start position:0% what do we want to achieve we want the 00:26:16.260 --> 00:26:17.870 align:start position:0% what do we want to achieve we want the indexer<00:26:16.620> to<00:26:16.740> make<00:26:16.860> money<00:26:17.039> or<00:26:17.279> we<00:26:17.460> want<00:26:17.580> five 00:26:17.870 --> 00:26:17.880 align:start position:0% indexer to make money or we want five 00:26:17.880 --> 00:26:19.730 align:start position:0% indexer to make money or we want five nights<00:26:18.299> right<00:26:18.600> the<00:26:18.840> quality<00:26:19.080> of<00:26:19.200> service<00:26:19.380> to 00:26:19.730 --> 00:26:19.740 align:start position:0% nights right the quality of service to 00:26:19.740 --> 00:26:22.130 align:start position:0% nights right the quality of service to to<00:26:19.980> be<00:26:20.220> super<00:26:20.340> high 00:26:22.130 --> 00:26:22.140 align:start position:0% to be super high 00:26:22.140 --> 00:26:24.890 align:start position:0% to be super high I<00:26:22.559> have<00:26:22.620> another<00:26:22.799> question<00:26:23.159> sorry<00:26:23.880> uh<00:26:24.539> maybe 00:26:24.890 --> 00:26:24.900 align:start position:0% I have another question sorry uh maybe 00:26:24.900 --> 00:26:26.269 align:start position:0% I have another question sorry uh maybe more<00:26:25.140> technical<00:26:25.440> when<00:26:25.679> you<00:26:25.860> show<00:26:26.039> the 00:26:26.269 --> 00:26:26.279 align:start position:0% more technical when you show the 00:26:26.279 --> 00:26:28.370 align:start position:0% more technical when you show the experiments<00:26:26.880> whenever<00:26:27.539> the<00:26:27.779> budget<00:26:28.080> of<00:26:28.260> the 00:26:28.370 --> 00:26:28.380 align:start position:0% experiments whenever the budget of the 00:26:28.380 --> 00:26:31.549 align:start position:0% experiments whenever the budget of the client<00:26:28.559> was<00:26:28.919> going<00:26:29.340> down<00:26:29.700> the<00:26:30.360> spread<00:26:30.840> of<00:26:31.140> the 00:26:31.549 --> 00:26:31.559 align:start position:0% client was going down the spread of the 00:26:31.559 --> 00:26:34.549 align:start position:0% client was going down the spread of the ocean<00:26:32.340> was<00:26:32.760> was<00:26:33.059> widening<00:26:33.659> but<00:26:33.840> the<00:26:34.080> mean<00:26:34.260> was 00:26:34.549 --> 00:26:34.559 align:start position:0% ocean was was widening but the mean was 00:26:34.559 --> 00:26:36.470 align:start position:0% ocean was was widening but the mean was things<00:26:34.799> the<00:26:35.100> same<00:26:35.220> which<00:26:35.640> means<00:26:35.940> that<00:26:36.179> you<00:26:36.360> are 00:26:36.470 --> 00:26:36.480 align:start position:0% things the same which means that you are 00:26:36.480 --> 00:26:38.330 align:start position:0% things the same which means that you are still<00:26:36.720> sampling<00:26:37.140> to<00:26:37.380> the<00:26:37.559> right<00:26:37.740> side<00:26:37.980> where 00:26:38.330 --> 00:26:38.340 align:start position:0% still sampling to the right side where 00:26:38.340 --> 00:26:40.010 align:start position:0% still sampling to the right side where you<00:26:38.520> know<00:26:38.700> it's<00:26:38.820> not<00:26:39.000> the<00:26:39.120> right<00:26:39.240> price<00:26:39.539> would 00:26:40.010 --> 00:26:40.020 align:start position:0% you know it's not the right price would 00:26:40.020 --> 00:26:41.149 align:start position:0% you know it's not the right price would it<00:26:40.200> be<00:26:40.320> more<00:26:40.440> effective<00:26:40.740> to<00:26:40.919> move<00:26:41.039> the 00:26:41.149 --> 00:26:41.159 align:start position:0% it be more effective to move the 00:26:41.159 --> 00:26:43.730 align:start position:0% it be more effective to move the gaussian<00:26:41.580> to<00:26:41.700> the<00:26:41.820> left<00:26:41.940> as<00:26:42.240> you<00:26:42.419> spread<00:26:42.779> it 00:26:43.730 --> 00:26:43.740 align:start position:0% gaussian to the left as you spread it 00:26:43.740 --> 00:26:46.430 align:start position:0% gaussian to the left as you spread it yeah<00:26:44.460> uh<00:26:44.940> so<00:26:45.360> what<00:26:45.539> what's<00:26:45.840> the<00:26:46.200> question 00:26:46.430 --> 00:26:46.440 align:start position:0% yeah uh so what what's the question 00:26:46.440 --> 00:26:49.730 align:start position:0% yeah uh so what what's the question actually<00:26:46.740> because<00:26:47.400> you<00:26:47.700> just<00:26:48.000> repeated<00:26:48.740> that 00:26:49.730 --> 00:26:49.740 align:start position:0% actually because you just repeated that 00:26:49.740 --> 00:26:52.610 align:start position:0% actually because you just repeated that the<00:26:50.279> design<00:26:50.760> Behavior<00:26:51.360> right<00:26:51.600> if<00:26:52.380> we 00:26:52.610 --> 00:26:52.620 align:start position:0% the design Behavior right if we 00:26:52.620 --> 00:26:53.810 align:start position:0% the design Behavior right if we overshoot 00:26:53.810 --> 00:26:53.820 align:start position:0% overshoot 00:26:53.820 --> 00:26:55.909 align:start position:0% overshoot if<00:26:54.240> we<00:26:54.360> overshoot<00:26:54.840> with<00:26:54.960> the<00:26:55.200> the<00:26:55.559> the<00:26:55.620> the 00:26:55.909 --> 00:26:55.919 align:start position:0% if we overshoot with the the the the 00:26:55.919 --> 00:26:58.669 align:start position:0% if we overshoot with the the the the price<00:26:56.760> then<00:26:57.539> we<00:26:57.779> don't<00:26:57.900> know<00:26:58.020> whether<00:26:58.260> the 00:26:58.669 --> 00:26:58.679 align:start position:0% price then we don't know whether the 00:26:58.679 --> 00:27:00.649 align:start position:0% price then we don't know whether the reason<00:26:58.799> was<00:26:59.039> there<00:26:59.460> were<00:26:59.580> no<00:26:59.760> queries<00:27:00.120> or<00:27:00.480> we 00:27:00.649 --> 00:27:00.659 align:start position:0% reason was there were no queries or we 00:27:00.659 --> 00:27:02.750 align:start position:0% reason was there were no queries or we were<00:27:00.840> too<00:27:00.960> expensive<00:27:01.559> right<00:27:01.860> so<00:27:02.159> we<00:27:02.400> spread 00:27:02.750 --> 00:27:02.760 align:start position:0% were too expensive right so we spread 00:27:02.760 --> 00:27:04.789 align:start position:0% were too expensive right so we spread because<00:27:03.000> we<00:27:03.240> want<00:27:03.419> to<00:27:03.539> sample<00:27:03.900> from<00:27:04.080> wider 00:27:04.789 --> 00:27:04.799 align:start position:0% because we want to sample from wider 00:27:04.799 --> 00:27:06.470 align:start position:0% because we want to sample from wider distribution<00:27:05.159> right 00:27:06.470 --> 00:27:06.480 align:start position:0% distribution right 00:27:06.480 --> 00:27:08.510 align:start position:0% distribution right all<00:27:06.840> right<00:27:07.020> I've<00:27:07.440> if<00:27:07.860> there<00:27:08.100> are<00:27:08.220> any<00:27:08.279> other 00:27:08.510 --> 00:27:08.520 align:start position:0% all right I've if there are any other 00:27:08.520 --> 00:27:10.730 align:start position:0% all right I've if there are any other you<00:27:09.179> know<00:27:09.240> additional<00:27:09.900> questions<00:27:10.080> I'm<00:27:10.500> I'm 00:27:10.730 --> 00:27:10.740 align:start position:0% you know additional questions I'm I'm 00:27:10.740 --> 00:27:13.370 align:start position:0% you know additional questions I'm I'm here<00:27:11.039> I'm<00:27:11.940> I'll<00:27:12.659> be<00:27:12.779> delighted<00:27:13.140> to<00:27:13.200> answer 00:27:13.370 --> 00:27:13.380 align:start position:0% here I'm I'll be delighted to answer 00:27:13.380 --> 00:27:14.810 align:start position:0% here I'm I'll be delighted to answer your<00:27:13.559> questions<00:27:13.799> but<00:27:13.980> it<00:27:14.100> seems<00:27:14.400> that<00:27:14.460> my<00:27:14.640> time 00:27:14.810 --> 00:27:14.820 align:start position:0% your questions but it seems that my time 00:27:14.820 --> 00:27:19.100 align:start position:0% your questions but it seems that my time is<00:27:14.940> up<00:27:15.179> so<00:27:15.480> thank<00:27:16.320> you<00:27:16.440> for<00:27:16.620> your<00:27:16.799> attention