Synchronised Swimming of Two Fish arxiv:6.4248v [physics.flu-dyn] 3 Oc 26 Guido Novai, Siddharha Verma, Dmiry Alexeev, Diego Rossinelli, Wim M. van Rees,2 and Peros Koumousakos Compuaional Science and Engineering Laboraory, Clausiussrasse 33, ETH Zürich, CH-892, Swizerland 2 School of Engineering and Applied Sciences, Harvard Universiy,USA We sudy he fluid dynamics of wo fish-like bodies wih synchronised swimming paerns. Our sudies are based on wo-dimensional simulaions of viscous incompressible flows. We disinguish beween moion paerns ha are exernally imposed on he swimmers and self-propelled swimmers ha learn manoeuvres o achieve cerain goals. Simulaions of wo rigid bodies execuing pre-specified moion indicae ha flow-mediaed ineracions can lead o subsanial drag reducion and may even generae hrus inermienly. In urn we examine wo self-propelled swimmers arranged in a leader-follower configuraion, wih a-priori specified body-deformaions. We find ha he swimming of he leader remains largely unaffeced, while he follower experiences eiher an increase or decrease in swimming speed, depending on he iniial condiions. Finally, we consider a follower ha synchronises is moion so as o minimize is laeral deviaions from he leader s pah. The leader employs a seady gai while he follower uses a reinforcemen learning algorihm o adap is swimming-kinemaics. We find ha swimming in a synchronised andem can yield up o abou 3% reducion in energy expendiure for he follower, in addiion o a 2% increase in is swimming-efficiency. The presen resuls indicae ha synchronised swimming of wo fish can be energeically beneficial. Key words: Swimming/flying, Propulsion, Vorex ineracions, Wakes. Inroducion The coordinaed moion of fish is hough o provide an energeic advanage o individuals, as well as o he group as a whole, in erms of increased swimming range, endurance and chances of survival. Schooling has been credied wih serving various oher biological funcions including defence from predaors (Brock & Riffenburgh 96; Cushing & Harden Jones 968), enhanced feeding and reproducive opporuniies (Shaw 978; Picher e al. 982). Amid a lack of clear agreemen regarding he evoluionary purpose of schooling behaviour (Pavlov & Kasumyan 2), here is growing evidence supporing he role of hydrodynamic mediaion in faciliaing propulsion. Experimens invesigaing fish swimming in groups poin o a reducion in energy expendiure, based on respiromeer readings and reduced ail-bea frequency (Parker 973; Abrahams & Colgan 985; Herskin & Seffensen 998; Svendsen e al. 23; Killen e al. 2). Imporanly, here is evidence o sugges ha reducion in energy expendiure is no disribued uniformly hroughou a schooling group. Herskin & Seffensen (998); Svendsen e al. (23); Killen e al. (2) observed ha he ail-bea frequency of railing fish was lower han ha of Email address for correspondence: peros@ehz.ch
2 Novai, Verma, Alexeev, Rossinelli, van Rees and Koumousakos fish a he fron of he school. Moreover, Killen e al. (2) noe ha fish wih inherenly lower aerobic scope prefer o say owards he rear of a group. Sudies invesigaing he response of soliary fish o unseady flow (Liao e al. 23) found ha rou swimming behind obsacles exered reduced effor for saion-keeping. The rou adoped a modified gai, which allowed hem o slalom hrough he oncoming vorex sree. The ensuing reducion in muscle aciviy was confirmed using neuromuscular measuremens (Liao e al. 23) and respiromeer readings (Taguchi & Liao 2). These experimenal sudies sugges ha fish can deec and exploi vorices presen in heir surroundings. There is a well documened hypohesis (Breder 965; Weihs 973, 975; Shaw 978) ha flow paerns which emerge as a consequence of schooling, can be exploied by individual swimmers. This hypohesis was firs quanified (Weihs 973, 975) by using inviscid poin-vorices as models of he fish wake-vorices. I was posulaed ha large groups of fish could gain a propulsive advanage by swimming in a diamond configuraion, wih opposing ail-bea phase. The energeic gain was aribued o wo disinc mechanisms: drag reducion resuling from decreased relaive velociy in he viciniy of specific vorices; and a forward push originaing from a channelling effec beween laeral neighbors. Weihs noed ha a rigid geomerical arrangemen, and perfecly synchronized ani-phase swimming among laeral neighbours, were unlikely o occur in naure. Noneheless, he posulaed ha given he immense poenial for energy savings, even inermien uilizaion of he proposed arrangemen could lead o a angible benefi (Weihs 975). The role of hydrodynamics in fish-schooling was laer quesioned (Parridge & Picher 979), based on empirical observaions of fishschools which rarely displayed diamond formaions. However, a laer sudy based on aerial phoographs of huning una schools (Parridge e al. 983) provided evidence for such diamond-like formaions. We believe ha hese sudies highligh he difficulies of mainaining fixed paerns in he dynamically evolving environmen of schooling fish. These difficulies are also refleced in simulaions sudies. Theoreical and numerical sudies of schooling have employed poenial flow models (Tsang & Kanso 23; Gazzola e al. 26), or hey have pre-specified he spaial disribuion and moion of he swimmers (Hemelrijk e al. 25; Daghooghi & Borazjani 25). Here we presen wo-dimensional simulaions of viscous, incompressible flows of muliple self-propelled swimmers ha can dynamically adap heir moion. We focus in paricular on wo swimmers arranged in a leader-follower configuraion. We invesigae he hydrodynamic ineracions of he swimmers in various scenarios including prespecified coordinaed moions and iniial disances, as well as he dynamic adapaion of he follower s moion using a reinforcemen learning algorihm, so as o remain wihin a specific region in he leader s wake. We invesigae he impac of he leader s wake on he follower s moion and idenify he mechanisms ha lead o energy savings. The paper is organised as follows: we ouline he numerical mehods for he simulaions of selfpropelled swimmers in Secion 2, and he reinforcemen learning algorihm is discussed in Secion 2.2. We presen resuls of he hree synchronised swimming scenarios in Secion 3, followed by concluding remarks in Secion 4. 2. Simulaion deails 2.. Swimmers and Numerical Mehods We solve he wo-dimensional, viscous, incompressible Navier-Sokes equaions in velociy-voriciy form using remeshed vorex mehods on wavele-adaped grids (Rossinelli e al. 25), and a divergence-free penalisaion echnique o enforce
Synchronised Swimming of Two Fish 3 he no-slip boundary condiion (Gazzola e al. 2). The wavele adapiviy and he compuaional efficiency of he solver are criical aspecs for his work as hey enable he uilisaion of he cosly reinforcemen learning algorihms. The self-propelled swimmers used in he simulaions are based on a simplified physical model of zebrafish as described in Gazzola e al. (2). Undulaions of he swimmer s body are generaed by imposing a spaially and emporally varying body curvaure (k(s, )), which passes down from he head o he ail as a sinusoidal ravelling wave: k(s, ) = A(s) sin [ 2π ( T p s L ) + φ ] (2.) Here, L is he lengh of he swimmer, T p = is he ail-bea frequency, φ is he phasedifference. The curvaure ampliude A(s) varies linearly from he head o he ail hus reducing head moion and amplifying ail-bea ampliude. We esimae he swimmingefficiency using a modified form of he Froude efficiency proposed by Tyell & Lauder (24): P hrus η = P hrus + max (P def, ) = T u T u + max ( u def df, ) (2.2) P hrus and P def represen he power oupu relaed o hrus generaed by he body, and he power exered in deforming he swimmer s body agains fluid-induced forces. The max operaor effecively clips he maximum of η o. This is necessary o avoid undefined values of η, which can occur when fluid-induced surface-forces and he deformaional velociy (u def ) poin in he same direcion, giving rise o negaive P def. The hrus is compued as T = (u df + u df )/2, where df = df P + df ν is comprised of he viscous- and pressure-based forces acing on he swimmer: df ν = 2µD n ds and df P = P n ds (2.3) Here, D = ( u + u T )/2 is he srain-rae ensor, P is he surface-pressure, and µ is he dynamic viscosiy, n represens he surface-normal and ds denoes he corresponding infiniesimal surface area. The surface-pressure is obained by solving a Poisson s equaion ( 2 P = ρ ( u T : u ) + ρλ (χ (u s u))) (Verma e al. submied). 2.2. Reinforcemen learning The wo swimmers eiher follow a-priori defined swimming paerns, or he follower adaps is body-deformaion o synchronise is moion wih ha of he leader. This adapaion is achieved using a Reinforcemen Learning (RL) (Suon & Baro 998), a poen machine learning algorihm for model-free flow conrol (Gauier e al. 25; Gazzola e al. 26). In RL, he agens receive informaion abou heir Sae and chose Acions o maximise a cumulaive fuure Reward in an unsupervised manner. The swimmer learns o esimae he acion-value Q(s, a) which is defined as he expeced sum of he discouned fuure rewards r(s, a, s ), for each acion a being performed in each sae s. The reward is obained by saring in s, performing a o end up in a new sae s, and hereafer following he policy π(s ): Q π (s, a) = E [r(s, a, s ) + γq(s, π(s ))] (2.4) The discoun facor γ [, ] deermines he rade-off beween immediae and fuure rewards and was se o γ =.8 for all presen resuls. The learning process erminaes upon convergence of Q(s, a), and he swimmer can make opimal decisions by following a greedy policy (π(s) = arg max a Q π (s, a)). The resul of his process is usually a abular approximaion of sae-acion-reward values. An imporan noe for he presen sudy is
4 Novai, Verma, Alexeev, Rossinelli, van Rees and Koumousakos K(/T - s/l) + Tp b=. + /2Tp y/l K(/T - s/l) - b=.5.2 + 3/2Tp -. - -.5 -.2 s/l.5 -.5 s/l.5 (a) b=-.5.2.4 x/l.6.8 (b) Figure : (a) Modificaion of he swimmer s midline curvaure (solid blue line) by superimposing opposing curvaure wih b =. The black dashed line corresponds o M (/Tp s/l) in Eq. 2.5, and he blue dash-do line indicaes he unmodified curvaure (i.e., he sinusoidal par of Eq. 2.). (b) The impac of varying he conrol-ampliude on he modified shape. The unmodified shape corresponds o b =. x y Figure 2: The leader swims along he horizonal line, he follower perceives is displacemen and inclinaion relaive o he leader. he realisaion ha he moion of he swimmer implies a coninuous sae space. Hence, in his work he swimmer learns a paramerized approximaion of Q(s, a) by raining a Neural Nework (NN) wih experience replay (Lin 992). The algorihm involves soring all observed ransiions {s, a, s, r}, which are sampled o updae he value funcion. Acions aken by a swimmer involve manipulaing is body curvaure in a manner which allows i o execue urns and o conrol is speed. This is achieved by inroducing a linear superposiion o he ravelling wave described in Eq. 2.: s s klearner (s, ) = k(s, ) + k (s, ) = A(s) sin 2π +φ +M Tp L Tp L (2.5) where M Tp s L defines a ravelling naural cubic spline, compued using hree evenly- spaced nodes separaed by a disance of L/4 (figure a). The spline shape remains consan as i proceeds from he head o he ail, and is deermined by a fixed conrolampliude b associaed wih a paricular acion. The swimmers are permied o execue an acion every half ail-bea period (Tp /2), which allows hem o eiher increase or reduce he undulaion ampliude (figures a and b). In he presen wo fish swimming (leader-follower andem) problem, learning is performed only by he follower. The follower defines is curren Sae using is displacemen ( x and y) and orienaion (θ) relaive o he leader (figure 2). Moreover, he follower also considers wheher i is aking an acion in he firs or second half of is ail-bea period, as par of is sae (modulo(, Tp )/Tp ). This is necessary because he same acion can eiher increase or decrease he mid-line curvaure, depending on wheher i is aken a TP or a TP /2 (figure a). Furhermore, he swimmer performs wo acions
Synchronised Swimming of Two Fish 5 every period, as described earlier. The effec of each acion ravels along he swimmer s body, affecing is ineracion wih he flow over he nex swimming period. For his reason, he sae of he swimmer also includes he wo acions aken over he previous ail-bea period. Here, he Reward used o provide feedback o he follower regarding is performance is defined as: R y = y. This funcion penalizes he follower when i laerally srays.5l oo far from he pah of he leader. The follower learns he policy π y which maximizes R y. The sae space is resriced o x/l 3, y/l.5 and θ π/2. When an acion leads he follower o exceed hese hresholds, he learner ransiions o a erminal sae wih reward R y =, and he simulaion is erminaed. 3. Resuls We disinguish exernally imposed moions on he swimmers o hose ha are achieved by he deformaion of he body of self-propelled swimmers. Resuls concerning hree disinc scenarios, namely, wo rigid airfoils execuing pre-specified moion, wo selfpropelled swimmers ineracing wihou conrol, and a smar follower uilizing adapive conrol o inerac wih he leader s wake, are discussed in his secion. 3.. Rigid objecs wih pre-specified moion A swimming paern ofen observed in schooling involves he exchange of he leader and follower posiions. We examine his scenario by firs sudying wo rigid, airfoilshaped bodies (shape idenical o swimmers) dragged along prescribed sinusoidal pahs o exchange heir posiion as leader and follower (see Movie ): { umax umin T a x () = s for 2nT s < (2nT s + ) u max u min (3.) T s for (2nT s + ) < 2n(T s + ) Here, n is an ineger, u max = 4.5L/T s, u min =.5L/T s, and T s represens he period wih which he bodies exchange heir posiion as leader and follower. The verical displacemen of he cener-of-mass is deermined as y( x, L) = L/5 cos (π x/l), where x is he horizonal disance raversed. The orienaion of he airfoils is aligned wih he angens of heir respecive rajecories. Boh he airfoils sar heir moion a he same x-locaion; one of he objecs is iniialized a a cres wih u max and undergoes seady deceleraion (Eq 3.), whereas he oher objec sars wih u min on a rough and is subjeced o consan acceleraion. This arrangemen of posiions and velociies alernaes beween he wo airfoils every -period T s. A snapsho of he resuling voriciy field, along wih he sinusoidal pah followed by he wo airfoils, is shown in figure 3. The flow paern ha emerges influences he ne drag acing on he wo objecs. We observe ha he follower in figure 3a experiences a dramaic reducion in drag, as indicaed by he dash-doed line in figure 3b ( 3.9). This can be aribued o a decrease in relaive velociy, due o he presence of he posiive vorex highlighed in figure 3a. The drag reducion a his insance is greaer han %, which corresponds o a ne hrus being generaed due o he ineracion of he follower s moion wih he wake. Moreover, figure 3b indicaes ha boh he leader and he follower may experience a reducion in drag as a resul of muual ineracion. The resuls sugges ha hydrodynamic ineracions beween solid objecs execuing specific moion paerns can give rise o subsanial drag reducion, and even inermien hrus producion.
6 Novai, Verma, Alexeev, Rossinelli, van Rees and Koumousakos Drag Reducion (%) 5 5 (a) 2 3 4 5 (b) Figure 3: (a) Voriciy field generaed by he wo fish-shaped airfoils dragged wih he prescribed sinusoidal paern (Re = umax L/ν = 225). The snapsho shown corresponds o = 3.88. (b) Percenage of drag reducion for he wo airfoils, wih respec o a single airfoil execuing he same moion paern. 3.2. Tandem of wo-self propelled swimmers: No Conrol We examine he behaviour of a self-propelled swimmer placed iniially in a andem configuraion wih a leader. Boh swimmers have a-priori defined body-deformaions. Their moions are deermined by heir deformaions and, in paricular for he follower, by heir ineracion wih he flow field. The kinemaics imposed for body-undulaions are idenical for boh he leader and he follower (Eq. 2.), and correspond o a Reynolds number of Re = L2 /TP ν = 5. The crucial difference from he configuraion sudied in Secion 3. is ha boh he swimmers are now self-propelled (Secion 2.), and heir rajecories are no imposed, bu emerge from heir ineracion wih he flow. We consider wo differen cases, wih he leader and he follower saring from res a a separaion disance of δ =.75L wih φ = (figure 4a), and a δ = 2.5L wih φ = π/2 (figure 4b). The voriciy fields shown in boh figures 4a and 4b correspond o insances when he follower firs encouners he leader s wake. We observe an increase of 9.5% in he follower s maximum velociy in he firs case (figure 4a, 4.4), whereas he follower in he second case experiences a velociy reducion of up o 9.% (figure 4b, 4.9). These resuls sugges ha hydrodynamic ineracion wih a leader s wake can have boh a beneficial, as well as a derimenal impac on he performance of a follower. Furhermore, in boh cases, he follower s rajecory sars deviaing laerally as soon as i encouners he wake, and he follower is compleely clear of he wake afer approximaely 4 o 6 ail-bea periods (supplemenary Movie 2). This suggess he need for acive modulaion of he railing swimmer s acions when navigaing he wake of a leader, in order o mainain a andem configuraion. 3.3. Tandem of wo-self propelled swimmers: Adapive Conrol In his secion, we discuss he swimming-efficiency of a follower ha adaps is moion using a RL algorihm, in response o velociy flucuaions in he leader s wake. The seady gai of he leader corresponds o a Reynolds number of Re = L2 /TP ν = 5. In order o ensure adequae exploraion of he sae space, he follower iniially performs random acions wih a 5% probabiliy, which is gradually reduced o %. The policy π y is deermined using approximaely, sae-acions-reward ses. The follower acively seeks o mainain is posiion in he cener of he leader s wake, as can be observed from he -evoluion of y in figure 5a (and supplemenary Movie 3).
Synchronised Swimming of Two Fish 7.8 velociy.75.7.65.6 2 3 4 5 6 7 (a).8 velociy.75.7.65.6 2 3 4 5 6 7 (b) Figure 4: The velociy of he leader (dash-do orange line), he follower (solid blue line), and a soliary swimmer (dashed black line) for (a) δ =.75L (wih he voriciy field shown a = 2.6) and (b) δ = 2.5L (voriciy field shown a = 3.6)..2.2 COTRelaive..6 -. -.2.8.4 + +2 (a) +3 +4 +5.2 + +2 +3 +4 +5 (b) Figure 5: (a) Laeral displacemen, and (b) CoT (equaion 3.2) of he follower, normalized wih he CoT of a soliary swimmer. Wihou acive conrol, he follower may ge defleced away from he wake, as discussed in secion 3.2. To examine he impac ha minimizing y has on he energy consumpion of he follower, we compue he Cos of Transpor (CoT) as follows: R max(pdef, )d Tp CoT() = (3.2) R kukd Tp The CoT indicaes he energy spen per uni disance ravelled. We remark ha he max operaor in Eq. 3.2 precludes negaive values of PDef, and accouns for he fac ha he railing swimmer may no sore energy from he flow. Figure 5b shows he CoT for he acive railing fish, normalized wih respec o he CoT of an isolaed swimmer (which remains approximaely consan during seady-sae swimming). The relaive CoT ends o be smaller han for he mos par, which is indicaive of he follower spending less
2 8 Novai, Verma, Alexeev, Rossinelli, van Rees and Koumousakos.9.8.7.6.5.4 +.5 + +.5 +2 +2.5 +3 +3.5 +4 +4.5 +5 (a).8.5.6.3 P Thrus.4 P Def..2 -. + +2 +3 +4 +5 (b) + +2 +3 +4 +5 (c) Figure 6: (a) Efficiency, (b) P hrus, and (c) P def measured over 5 swimming periods for a soliary passive swimmer (dashed black line), and for he follower acing according o π y (solid blue line). Power measuremens are non-dimensionalized by ml 2 /Tp 3 (m represens he mass of he swimmer). energy in raversing a uni disance compared o an isolaed swimmer. There are insances when he relaive CoT exceeds, which corresponds o he follower exering addiional effor o execue correcive acions. Over a course of 4 -periods, acively minimizing he laeral disance from he leader resuls in subsanial energy savings per uni disance ravelled; he swimmer following π y requires 29.3% less energy han a soliary swimmer in an unperurbed flow. These resuls showcase he significan energeic benefis ha can be obained by a follower when exploiing a leader s wake. In addiion o he CoT, we examine he efficiency η (Eq. 2.2), he hrus-relaed power P hrus, and power consumed by body-deformaion P Def for a soliary swimmer adoping a seady gai, and he follower acing according o π y (figure 6). The acive follower experiences an increase in swimming-efficiency (figure 6a). This poins o an abiliy o exrac energy from he oncoming vorices, and a consequenial reducion in effor exered by he swimmer. The ne increase in average efficiency over a duraion of 4 -periods is approximaely 9.4%. These gains do no arise due o an increase in P T hrus (figure 6b), bu raher due o a reducion in P Def (figure 6c). The -averaged P T hrus over 4 -periods varies only moderaely for he acive swimmer compared o he soliary swimmer (.2%), bu he reducion in P Def is subsanial ( 36.6%). This may be
Synchronised Swimming of Two Fish 9 relaed o he fac ha he follower ends o favour a decrease, raher han an increase, in he undulaion-ampliude (secion 2.2). The hrus- and deformaion-power for he follower show a noiceable variaion in ampliude, compared o hose for a soliary swimmer (figure 6b). The flucuaing poweroupu is relaed o he fac ha he disance-based reward R y solely aims o minimize y. This can affec efficiency adversely for relaively shor duraions, as observed a s ( +.5), ( + 3.5) and ( + 4.5) in figure 6a. Noneheless, he smar follower is more efficien on average han a soliary swimmer (9.4% higher efficiency). This indicaes ha he subsanial reducion in energy consumpion (29.3% drop in relaive CoT) does no come a he expense of decreased efficiency. 4. Conclusion In his paper, we demonsrae he energeic benefis of coordinaed swimming, for wo swimmers in a leader-follower configuraion hrough a series of simulaions. Firs, an arrangemen of rigid airfoil-shaped swimmers, execuing pre-specified moion, is observed o give rise o subsanial drag reducion. Following his, we invesigae self-propelled fish shapes, wih boh he leader and he follower employing idenical kinemaics. Wihou any acive adapaion, he follower s ineracions wih he leader s wake can be eiher energeically beneficial or derimenal, depending on he iniial condiion. Furhermore, he follower ends o diverge from he leader s wake, which poins o he need for acive modulaion of he follower s acions o mainain a sable andem configuraion. Finally, we examine, for he firs o he bes of our knowledge, he case where he leader swims wih a seady gai and he follower adaps is behaviour dynamically o accoun for he effecs of he wake encounered. The acions of he follower are seleced auonomously from an opimal policy deermined via reinforcemen learning, and allow he swimmer o maximize a specified long-erm reward. The resuls indicae ha swimming in andem can lead o measurable energy savings for he follower. We measure abou 3% reducion in energy spen per uni disance, compared o a soliary swimmer, even when he goal of he follower is o minimize laeral disance from he leader. The resuls demonsrae ha, for wo fish swimming in a synchronised andem configuraion, can give rise o subsanial energeic benefis. Curren work exends hese simulaions o hree-dimensional flows by deploying wavele adaped vorex o massively parallel compuing archiecures. We envision ha his work will be imporan for he design of energeically efficien roboic devices ha need o accoun for srong hydrodynamic ineracions. Acknowldgemen This work uilized compuaional resources graned by he Swiss Naional Supercompuing Cenre (CSCS) under projec ID s436. We graefully acknowldge suppor by he European Research Council Advanced Invesigaor Award. REFERENCES Abrahams, M. V. & Colgan, P. W. 985 Risk of predaion, hydrodynamic efficiency and heir influence on school srucure. Environ. Biol. Fish. 3 (3), 95 22. Breder, C. M. 965 Vorices and fish schools. Zoologica-N.Y. 5 (2), 97 4. Brock, V. E. & Riffenburgh, R. H. 96 Fish schooling: A possible facor in reducing predaion. ICES J. Mar. Sci. 25 (3), 37 37.
Novai, Verma, Alexeev, Rossinelli, van Rees and Koumousakos Cushing, D. H. & Harden Jones, F. R. 968 Why do fish school? Naure 28, 98 92. Daghooghi, M. & Borazjani, I. 25 The hydrodynamic advanages of synchronized swimming in a recangular paern. Bioinspir. Biomim. (5), 568. Gauier, N., Aider, J.-L., Duriez, T., Noack, B. R., Segond, M. & Abel, M. 25 Closed-loop separaion conrol using machine learning. J. Fluid Mech. 77, 442 457. Gazzola, M., Chaelain, P., van Rees, W. M. & Koumousakos, P. 2 Simulaions of single and muliple swimmers wih non-divergence free deforming geomeries. J. Compu. Phys. 23, 793 74. Gazzola, M., Tchieu, A. A., Alexeev, D., de Brauer, A. & Koumousakos, P. 26 Learning o school in he presence of hydrodynamic ineracions. J. Fluid Mech. 789, 726 749. Hemelrijk, C. K., Reid, D. A. P., Hildenbrand, H. & Padding, J. T. 25 The increased efficiency of fish swimming in a school. Fish Fish. 6 (3), 5 52. Herskin, J. & Seffensen, J. F. 998 Energy savings in sea bass swimming in a school: measuremens of ail bea frequency and oxygen consumpion a differen swimming speeds. J. Fish Biol. 53 (2), 366 376. Killen, S. S., Marras, S., Seffensen, J. F. & McKenzie, D. J. 2 Aerobic capaciy influences he spaial posiion of individuals wihin fish schools. P. Roy. Soc. Lond. B Bio. 279 (727), 357 364. Liao, J. C., Beal, D. N., Lauder, G. V. & Trianafyllou, M. S. 23 Fish exploiing vorices decrease muscle aciviy. Science 32, 566 569. Lin, L. 992 Self-improving reacive agens based on reinforcemen learning, planning and eaching. Mach. Learn. 8 (3-4), 293 32. Parker, F. R. 973 Reduced meabolic raes in fishes as a resul of induced schooling. T. Am. Fish. Soc. 2 (), 25 3. Parridge, B. L., Johansson, J. & Kalish, J. 983 The srucure of schools of gian bluefin una in Cape Cod Bay. Environ. Biol. Fish. 9 (3), 253 262. Parridge, B. L. & Picher, T. J. 979 Evidence agains a hydrodynamic funcion for fish schools. Naure 279, 48 49. Pavlov, D. S. & Kasumyan, A. O. 2 Paerns and mechanisms of schooling behavior in fish: A review. J. Ichhyol. 4 (2), 63 23. Picher, T. J., Magurran, A. E. & Winfield, I. J. 982 Fish in larger shoals find food faser. Behav. Ecol. Sociobiol. (2), 49 5. Rossinelli, D., Hejazialhosseini, B., van Rees, W. M., Gazzola, M., Bergdorf, M. & Koumousakos, P. 25 MRAG-I2D: Muli-resoluion adaped grids for remeshed vorex mehods on mulicore archiecures. J. Compu. Phys. 288, 8. Shaw, E. 978 Schooling Fishes: The school, a ruly egaliarian form of organizaion in which all members of he group are alike in influence, offers subsanial benefis o is paricipans. Am. Sci. 66 (2), 66 75. Suon, R. S. & Baro, A. G. 998 Reinforcemen learning: An inroducion. MIT press. Svendsen, J. C., Skov, J., Bildsoe, M. & Seffensen, J. F. 23 Inra-school posiional preference and reduced ail bea frequency in railing posiions in schooling roach under experimenal condiions. J. Fish Biol. 62 (4), 834 846. Taguchi, M. & Liao, J. C. 2 Rainbow rou consume less oxygen in urbulence: he energeics of swimming behaviors a differen speeds. J. Exp. Biol. 24 (9), 428 436. Tsang, A. C. H. & Kanso, E. 23 Dipole ineracions in doubly periodic domains. J. Nonlinear Sci. 23 (6), 97 99. Tyell, E. D. & Lauder, G. V. 24 The hydrodynamics of eel swimming. J. Exp. Biol. 27 (), 825 84. Verma, S., Abbai, G., Novai, G. & Koumousakos, P. submied Compuing he force disribuion on he surface of complex, deforming geomeries using vorex mehods and brinkman penalizaion. Submied. Weihs, D. 973 Hydromechanics of fish schooling. Naure 24, 29 29. Weihs, D. 975 Swimming and Flying in Naure: Volume 2, chap. Some Hydrodynamical Aspecs of Fish Schooling, pp. 73 78. Boson, MA: Springer US.